bot-backend
0 followers · 0 following
  • Joined on 2026-05-27
Repositories Projects Packages Public activity Starred repositories
bot-backend commented on issue lekss361/gendesign#823 2026-05-30 19:53:31 +00:00
[tradein][scrapers] Avito: детект block/captcha-страниц (HTTP-200) → raise, не «0 lots»

PR #830 (feat/823-avito-blockpage) → review. Дуп-чек: основная часть (HTTP-200 block/captcha → raise) УЖЕ реализована ранее — _is_firewall_page()…

bot-backend commented on issue lekss361/gendesign#821 2026-05-30 19:53:25 +00:00
[P1][tradein][backend][scrapers] base.py ON CONFLICT не персистит listing_date/area_m2 на re-scrape (UPDATE-ветка) — COALESCE-backfill

PR #829 (feat/821-coalesce-backfill) → review. Ровно 2 COALESCE-строки в ON CONFLICT SET (grep → 2), INSERT VALUES не тронут, +3 теста (SQL-text + params +…

bot-backend created pull request lekss361/gendesign#830 2026-05-30 19:53:04 +00:00
fix(scrapers): avito per-card parse_failures counter + logging (Refs #823)
bot-backend created pull request lekss361/gendesign#829 2026-05-30 19:52:40 +00:00
fix(scrapers): COALESCE-backfill listing_date/area_m2 in save_listings ON CONFLICT (Refs #821)
bot-backend pushed to feat/823-avito-blockpage at lekss361/gendesign 2026-05-30 19:51:56 +00:00
53130d6a4b fix(scrapers): detect avito HTTP-200 block/captcha page -> raise (Refs #823)
bot-backend created branch feat/823-avito-blockpage in lekss361/gendesign 2026-05-30 19:51:56 +00:00
bot-backend pushed to feat/821-coalesce-backfill at lekss361/gendesign 2026-05-30 19:49:13 +00:00
4b3c67b012 fix(scrapers): COALESCE-backfill listing_date/area_m2 in save_listings ON CONFLICT (Refs #821)
bot-backend created branch feat/821-coalesce-backfill in lekss361/gendesign 2026-05-30 19:49:13 +00:00
bot-backend created pull request lekss361/gendesign#820 2026-05-30 19:25:54 +00:00
fix(tradein): import trade-in.css в ui-preview (#801)
bot-backend commented on issue lekss361/gendesign#726 2026-05-30 19:17:39 +00:00
[P1][tradein][backend] avito SERP: listing_date=None у 91.5% — восстановить извлечение даты

⚠️ **Кодовая часть уже реализована и зелёная — оставшийся 91.5% None это historical-data + выключенный sweep, не отсутству…

bot-backend commented on issue lekss361/gendesign#775 2026-05-30 19:13:46 +00:00
[P2][tradein][backend][scrapers] Парсить из embedded-state JSON: Yandex 82% NULL area + Cian buildingCadastralNumber не персистится

⚠️ Обе части уже реализованы и покрыты тестами — кодовой работы не осталось (verify file:line ниже, per «конфликт…

bot-backend commented on pull request lekss361/gendesign#818 2026-05-30 19:08:11 +00:00
feat(scrapers): route cian sessions through mobile proxy (Refs #806)

fixup 1/1 (d815d7b) — поправил env-binding ровно как указал reviewer:

  • config.py: `scraper_proxy_url_env: str
bot-backend pushed to fix/806-cian-proxy at lekss361/gendesign 2026-05-30 19:07:58 +00:00
d815d7ba83 fixup(scrapers): bind SCRAPER_PROXY_URL via validation_alias + env-binding test (#806)
bot-backend created pull request lekss361/gendesign#819 2026-05-30 19:04:48 +00:00
fix(tradein): cian _cianConfig concat-формат + auth из header-frontend (#639)
bot-backend commented on issue lekss361/gendesign#806 2026-05-30 19:01:42 +00:00
[tradein][backend][scrapers] Проксировать cian-скрейперы (cian.py/cian_detail/cian_session) через mobile proxy

PR (fix/806-cian-proxy) → status/review. Generic scraper_proxy_url (SCRAPER_PROXY_URL→AVITO_PROXY_URL fallback, zero prod env change); proxies= в cian.py/cian_detail/cian_session +…

bot-backend created pull request lekss361/gendesign#818 2026-05-30 19:01:39 +00:00
feat(scrapers): route cian sessions through mobile proxy (Refs #806)
bot-backend created branch fix/806-cian-proxy in lekss361/gendesign 2026-05-30 19:01:25 +00:00
bot-backend pushed to fix/806-cian-proxy at lekss361/gendesign 2026-05-30 19:01:25 +00:00
e5f4e37415 feat(scrapers): route cian sessions through mobile proxy (Refs #806)
bot-backend commented on issue lekss361/gendesign#639 2026-05-30 18:55:42 +00:00
🔴 [tradein][вторичка][scrapers] Рефреш Cian session-куки (DMIR_AUTH) — разблокирует cian-каскад

ROOT CAUSE найден 2026-05-30 — это НЕ протухшие куки, а дрейф формата _cianConfig

Диагностика на проде (валидная сессия,…

bot-backend commented on issue lekss361/gendesign#775 2026-05-30 18:53:26 +00:00
[P2][tradein][backend][scrapers] Парсить из embedded-state JSON: Yandex 82% NULL area + Cian buildingCadastralNumber не персистится

Reopened Part A (yandex area 18% на проде) — investigation-blocked, не беру для авто-воркера. Как и в комменте аналитика: нужно…