viktor/wrongmove
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

bugfix - reraise the error when getting 429 so that we retry later

Browse source
This commit is contained in:
Viktor Barzin 2025-06-30 23:24:16 +00:00
parent a84dcc0588
commit 59c33428c2
No known key found for this signature in database
GPG key ID: 4056458DBDBF8863
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
crawler/3_dump_images.py
View file

@ -49,3 +49,4 @@ async def dump_images_for_listing(listing: Listing, base_path: Path) -> Listing
return listing return listing
except Exception as e: except Exception as e:
tqdm.write(f"Error for {url}: {e}") tqdm.write(f"Error for {url}: {e}")
raise e # raise so that we retry it