Requests to Rightmove API previously had no explicit timeout, causing hung connections to block workers indefinitely. Add a configurable request_timeout (default 30s) to ScraperConfig and apply it to all aiohttp sessions. Also retry on TimeoutError in addition to ThrottlingError for all API query functions. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| routing_config.py | ||
| schedule_config.py | ||
| scraper_config.py | ||