Commit graph

252 commits

Author SHA1 Message Date
Viktor Barzin
480957dc72
add timeout when fetching details and use new entrypoint for task processing 2025-08-23 22:20:42 +00:00
Viktor Barzin
e5c68f6bb7
add opentelemetry 2025-08-02 17:25:56 +00:00
Viktor Barzin
d1cef99c5a
make task processing a bit better. still doing 1 query to check if needs processing; will fix later 2025-07-27 20:09:41 +00:00
Viktor Barzin
87efe0694c
format progress to 2 digits and add status updates before starting 2025-07-27 18:47:09 +00:00
Viktor Barzin
91a0436f7f
migrate processing to a pipeline approach where each listing is processed in a pipeline in parallel and status reported back to track progress 2025-07-27 18:33:39 +00:00
Viktor Barzin
4fa09e31c8
make property image clickable 2025-07-27 11:11:04 +00:00
Viktor Barzin
42ed20b833
read slack notification webhook url from env 2025-07-26 13:15:21 +00:00
Viktor Barzin
4e7734d327
add healtcheck api endpoint 2025-07-26 13:06:28 +00:00
Viktor Barzin
206471cee8
fix argument error in tasks 2025-07-26 10:38:51 +00:00
Viktor Barzin
272d54d014
add daily scrape of interesting rent listings 2025-07-25 22:14:45 +00:00
Viktor Barzin
762408e054
add apprise and send notification when refreshing listings 2025-07-25 21:32:06 +00:00
Viktor Barzin
ce386e748d
default to last seen 28 days from 7 2025-07-15 18:52:25 +00:00
Viktor Barzin
c98f6ff97f
hack - add available from parameter only for rent listings 2025-07-06 12:18:32 +00:00
Viktor Barzin
d4b22deda0
save user queries in redis so that user can refresh the page and still come back to their latest task 2025-07-06 12:02:25 +00:00
Viktor Barzin
a055c92dea
split listing query into multiple subqueries to avoid hittign the 1.5k rightmove limit 2025-07-06 12:00:12 +00:00
Viktor Barzin
241b8d1842
bugfix fetching prices for buy listings 2025-07-06 11:48:36 +00:00
Viktor Barzin
db85cf2d3a
be more explicit with what the parameter submit buttons do 2025-07-04 23:10:43 +00:00
Viktor Barzin
7c43907c2f
welcome email as not all users have given names 2025-07-01 16:28:56 +00:00
Viktor Barzin
20ff91d663
reduce concurrency when fetching images + add retries 2025-07-01 16:12:06 +00:00
Viktor Barzin
59c33428c2
bugfix - reraise the error when getting 429 so that we retry later 2025-06-30 23:24:16 +00:00
Viktor Barzin
a84dcc0588
bugfix - print sql statemnts only in dev 2025-06-30 23:22:12 +00:00
Viktor Barzin
3a4fbdf99a
run migrations as part of prod run 2025-06-30 23:14:30 +00:00
Viktor Barzin
5adffc8dcf
make a few columns in the listing model indices to help with search 2025-06-30 22:57:41 +00:00
Viktor Barzin
92c8403157
add subtitle to the login modal with instructions on how to get invited 2025-06-30 22:39:37 +00:00
Viktor Barzin
c660771225
change api port to 5001 2025-06-24 19:12:20 +00:00
Viktor Barzin
8ab79b7c72
squash parametrs form to take less space 2025-06-23 21:16:07 +00:00
Viktor Barzin
a526f81517
add api endpoint for getting all available districts 2025-06-23 21:09:03 +00:00
Viktor Barzin
e05b4788e0
show spinner while running backgroun task 2025-06-23 19:45:53 +00:00
Viktor Barzin
5a9a837b27
handle serialization of result more generically - if we cannot json dumps, then return string representation 2025-06-23 19:45:31 +00:00
Viktor Barzin
a0d099e62b
expiry tasks after 10 minutes; also handle expired tasks 2025-06-23 19:43:54 +00:00
Viktor Barzin
7cea586f41
update start sh to work with environemtns and update dockerfile to use it to start all needed services 2025-06-23 19:13:19 +00:00
Viktor Barzin
5610f1d868
remove deleted import for worker 2025-06-22 22:39:51 +00:00
Viktor Barzin
68d88de464
disable kubectl port forwarding and instead rely on a docker contaier for redis 2025-06-22 21:33:02 +00:00
Viktor Barzin
9a164ddfdc
migrate frontend to use new celery api and improve ux around spinners whilst loading 2025-06-22 21:32:46 +00:00
Viktor Barzin
1ad8a12f3d
add start.sh for backend as we need to start multiple services now 2025-06-22 21:19:19 +00:00
Viktor Barzin
93129333e6
migrate background tasks to celery 2025-06-22 21:18:52 +00:00
Viktor Barzin
efe3248c07
migrate to using db connection string from env 2025-06-22 21:16:55 +00:00
Viktor Barzin
84a55eefde
add default dir path for image dumps 2025-06-22 21:15:50 +00:00
Viktor Barzin
3d024277fb
add uvicorn logger when dumping listings 2025-06-22 21:15:35 +00:00
Viktor Barzin
24b41ae2ed
add celery env variables to sample env 2025-06-22 21:15:15 +00:00
Viktor Barzin
069969c14a
bugfix - remove trailing slash in authentik config which was causing an additional request that was always redirected 2025-06-22 14:25:43 +00:00
Viktor Barzin
744fa7b8a7
use the uvicorn logger; also update dockerfile to run migrations as parto f startup instead of when starting uvicorn 2025-06-22 14:00:47 +00:00
Viktor Barzin
684af9a040
add helpful adb commands to the readme 2025-06-22 13:06:37 +00:00
Viktor Barzin
bf79d3c977
convert district at the last moment - when we send the query 2025-06-22 13:05:53 +00:00
Viktor Barzin
bcece4500a
set debug level to debug 2025-06-22 13:05:24 +00:00
Viktor Barzin
9eae30b0d6
bugfix - pages start from 1 2025-06-22 13:04:10 +00:00
Viktor Barzin
03d24aff99
refactor dump listings to extract all pages with data 2025-06-22 12:43:24 +00:00
Viktor Barzin
fbd39bb67f
replace available from component with a nicer search which takes human input 2025-06-21 23:46:19 +00:00
Viktor Barzin
ce199152e2
add available from filter 2025-06-21 23:22:11 +00:00
Viktor Barzin
8c65aa0916
add logger for more strucutred logging in python 2025-06-21 22:38:30 +00:00