viktor/wrongmove
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

add command to export the data in a way that the ui (immoweb) can consume

Browse source
This commit is contained in:
Viktor Barzin 2025-05-26 19:36:54 +00:00
parent 102c20ac42
commit 7e8c79d3d1
No known key found for this signature in database
GPG key ID: 4056458DBDBF8863
4 changed files with 66 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

4
crawler/runall.sh
View file

@ -4,10 +4,10 @@ set -euxo pipefail
DATA_DIR="data/rs"
python main.py --data-dir $DATA_DIR dump-listings --min-price 2500 --max-price 3500 --min-bedrooms 2 --max-bedrooms 4 --district islington -t rent
python main.py --data-dir $DATA_DIR dump-listings --min-price 2000 --max-price 4000 --min-bedrooms 2 --max-bedrooms 4 -t rent
python main.py --data-dir $DATA_DIR dump-details
python main.py --data-dir $DATA_DIR dump-images
python main.py --data-dir $DATA_DIR detect-floorplan
#python main.py --data-dir $DATA_DIR routing --destination-address 'Meta Brock Street' -m transit # NOTE: THIS CONSUMES API CALLS; USE CAREFULLY; add -l to limit number of entries
python main.py --data-dir $DATA_DIR export-csv -O data/listings.csv
python main.py --data-dir $DATA_DIR export-immoweb -O ../immoweb/data/london_geojs.js