lekss361/gendesign
1
0
Fork 0
Code Issues 57 Pull requests Projects Releases Packages Wiki Activity Actions

fix(tradein): cian _rotate_ip uses cian_proxy_rotate_url; page-scope idiom

Browse source 
Review #926 fixups:
- _rotate_ip: cian_proxy_rotate_url or avito_proxy_rotate_url (was avito-only →
  rotated wrong proxy IP on Cian ban, ignored CIAN_PROXY_ROTATE_URL).
- pagination log: dir() → locals() for local-var existence check.
This commit is contained in:
bot-backend 2026-05-31 22:51:52 +03:00
parent 46269b527a
commit 587564153f
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
tradein-mvp/backend/app/services/scrapers/cian.py
View file

@ -155,7 +155,7 @@ class CianScraper(BaseScraper):
мобильному модему нужно время поднять новый IP. Returns True при успехе. мобильному модему нужно время поднять новый IP. Returns True при успехе.
Зеркало AvitoScraper._rotate_ip (#623). Зеркало AvitoScraper._rotate_ip (#623).
""" """
rotate_url = settings.avito_proxy_rotate_url rotate_url = settings.cian_proxy_rotate_url or settings.avito_proxy_rotate_url
if not rotate_url: if not rotate_url:
return False return False
sep = "&" if "?" in rotate_url else "?" sep = "&" if "?" in rotate_url else "?"
@ -573,7 +573,7 @@ class CianScraper(BaseScraper):
room_label, room_label,
lo, lo,
hi, hi,
min(max_pages, page if "page" in dir() else 1), min(max_pages, page if "page" in locals() else 1),
max_pages, max_pages,
collected_this_bucket, collected_this_bucket,
len(seen), len(seen),