Commit graph

21 commits

Author SHA1 Message Date
Kadir
d4f87bed76 add routing and util to the right places 2024-03-13 16:22:53 +00:00
Kadir
a9b8d4d630 adding musthave and lastXdays 2024-03-13 16:21:54 +00:00
Kadir
36258d877f crawling for 3 and refactoring to allow incremental crawls 2024-03-11 14:43:53 +00:00
Kadir
de2639f9c3 fixing bugs, adding properties for querying and analysis§ 2024-03-11 09:44:37 +00:00
Kadir
d108bf11ee adding tesseract OCR for floorplan detection 2024-03-10 22:32:34 +00:00
Kadir
508aa02812 Real crawling scripts and floorplan detection
1. get all listings
2. get all detail jsons
3. get all images
4. get all floorplans
5. detecting floorplans

Also updating dependencies for huggingface etc.
2024-03-10 18:49:39 +00:00
Kadir
46bb641026 adding floorplans, detail json, refactored the folders 2024-03-07 22:02:09 +00:00
Kadir
e2f7998ee9 merging the visual query answering with the crawler. Monorepo go! 2024-03-01 16:42:48 +01:00
Kadir
85686a8b24 update tasks 2024-02-29 20:00:18 +01:00
Kadir
83b3f1d3fd Adding the duration and distance aggregation from the routes api 2024-02-29 19:58:54 +01:00
Kadir
ce9956ea52 Routes API implemented for travel time 2024-02-29 18:14:42 +01:00
Kadir
5349088ba0 routing temp 2024-01-29 01:09:56 +00:00
Kadir Tugan
f30115eecd Fixing __repr__ for RightmoveListing and adding a small testing script 2023-11-18 13:25:00 +02:00
Kadir Tugan
8698b41e0e adding lat/lon to the db 2023-11-18 13:09:03 +02:00
Kadir Tugan
72ff6a7202 adding query to fetch a single detailpage 2023-11-18 12:56:15 +02:00
Kadir Tugan
cfd98ed40c adding tasks file 2023-11-18 12:46:11 +02:00
Kadir Tugan
31d760cf30 adding more parameters to the function 2023-11-18 12:38:54 +02:00
Kadir Tugan
d49b11e28b ruff format 2023-11-18 12:30:04 +02:00
Kadir Tugan
65fc4cdda4 updating poetry 2023-11-18 12:20:22 +02:00
Kadir Tugan
200caadabd Makefile to remake db 2023-11-06 00:33:49 +00:00
Kadir Tugan
4ee7ae16c4 Initial commit: Rightmove fetch, database, caching, poetry etc.
- Fetching rightmove listing api
- Memoizing query
- Writing to sqlite database with sqlalchemy
- Poetry dependencies
2023-11-06 00:31:58 +00:00