lekss361/gendesign
1
0
Fork 0
Code Issues 57 Pull requests Projects Releases Packages Wiki Activity Actions
gendesign/tradein-mvp/backend/app/services/scrapers
History
lekss361 628d8ad08c feat(tradein-scrapers): parse listing_date from Avito + Yandex cards 
60% analogs пришли с listing_date=null → est_days_on_market не считался.
- avito.py: _parse_relative_date() regex для 'N дней/недель/месяцев назад',
  извлекаем из data-marker=item-date + fallback на card text
- yandex_helpers.py: parse_listing_date() — absolute RU date + relative fallback
- yandex_realty.py: заменяем parse_ru_date() → parse_listing_date()
- тест test_avito_relative_date.py: days/weeks/hours/None cases
- cian.py не тронут (уже парсит listing_date из addedTimestamp)

Source: estimate a0a0b820-e8a8-4eee-aa73-0ab3b98ac233 (6/10 null listing_date).
2026-05-24 14:00:17 +03:00
..
__init__.py feat: add tradein-mvp subproject (Trade-In Estimator под /trade-in) 2026-05-21 00:25:39 +03:00
avito.py feat(tradein-scrapers): parse listing_date from Avito + Yandex cards 2026-05-24 14:00:17 +03:00
avito_detail.py fix(tradein-avito): strip Emotion CSS from listings.address (#502) 2026-05-24 10:52:50 +00:00
avito_exceptions.py fix(tradein/avito): anti-bot hardening — sleep + abort + shared session (#487) 2026-05-23 20:08:40 +00:00
avito_houses.py fix(tradein/avito): anti-bot hardening — sleep + abort + shared session (#487) 2026-05-23 20:08:40 +00:00
avito_imv.py feat(tradein): avito_imv.py — Avito IMV evaluation API client (2 requests) (#444) 2026-05-23 12:16:47 +00:00
base.py feat(tradein): extend base.py save_listings to persist Cian-specific columns (PR #450 follow-up) (#455) 2026-05-23 13:05:20 +00:00
cian.py feat(tradein): global scraper delay setting (applies across all scrapers) (#485) 2026-05-23 15:43:28 +00:00
cian_detail.py feat(tradein): cian_session cookies management + admin endpoints (Wave 4 Worker A) (#457) 2026-05-23 13:22:00 +00:00
cian_newbuilding.py feat(tradein): cian_newbuilding.py — ЖК catalog scraper (chart + reliability + offers, Wave 4 Worker C) (#459) 2026-05-23 13:23:11 +00:00
cian_state_parser.py feat(tradein): cian_state_parser shared utility + ScrapedLot Cian fields (#447) 2026-05-23 12:35:01 +00:00
cian_valuation.py feat(tradein): cian_valuation.py — auth-required Calculator scraper + 24h cache (#465) 2026-05-23 13:43:34 +00:00
n1.py feat(tradein): global scraper delay setting (applies across all scrapers) (#485) 2026-05-23 15:43:28 +00:00
yandex_detail.py feat(tradein): scraper_settings live-config + Yandex admin trigger endpoints (#484) 2026-05-23 15:28:34 +00:00
yandex_helpers.py feat(tradein-scrapers): parse listing_date from Avito + Yandex cards 2026-05-24 14:00:17 +03:00
yandex_newbuilding.py feat(tradein): scraper_settings live-config + Yandex admin trigger endpoints (#484) 2026-05-23 15:28:34 +00:00
yandex_realty.py feat(tradein-scrapers): parse listing_date from Avito + Yandex cards 2026-05-24 14:00:17 +03:00
yandex_valuation.py feat(tradein): scraper_settings live-config + Yandex admin trigger endpoints (#484) 2026-05-23 15:28:34 +00:00