Commit graph

234 commits

Author SHA1 Message Date
Viktor Barzin
20ff91d663
reduce concurrency when fetching images + add retries 2025-07-01 16:12:06 +00:00
Viktor Barzin
59c33428c2
bugfix - reraise the error when getting 429 so that we retry later 2025-06-30 23:24:16 +00:00
Viktor Barzin
a84dcc0588
bugfix - print sql statemnts only in dev 2025-06-30 23:22:12 +00:00
Viktor Barzin
3a4fbdf99a
run migrations as part of prod run 2025-06-30 23:14:30 +00:00
Viktor Barzin
5adffc8dcf
make a few columns in the listing model indices to help with search 2025-06-30 22:57:41 +00:00
Viktor Barzin
92c8403157
add subtitle to the login modal with instructions on how to get invited 2025-06-30 22:39:37 +00:00
Viktor Barzin
c660771225
change api port to 5001 2025-06-24 19:12:20 +00:00
Viktor Barzin
8ab79b7c72
squash parametrs form to take less space 2025-06-23 21:16:07 +00:00
Viktor Barzin
a526f81517
add api endpoint for getting all available districts 2025-06-23 21:09:03 +00:00
Viktor Barzin
e05b4788e0
show spinner while running backgroun task 2025-06-23 19:45:53 +00:00
Viktor Barzin
5a9a837b27
handle serialization of result more generically - if we cannot json dumps, then return string representation 2025-06-23 19:45:31 +00:00
Viktor Barzin
a0d099e62b
expiry tasks after 10 minutes; also handle expired tasks 2025-06-23 19:43:54 +00:00
Viktor Barzin
7cea586f41
update start sh to work with environemtns and update dockerfile to use it to start all needed services 2025-06-23 19:13:19 +00:00
Viktor Barzin
5610f1d868
remove deleted import for worker 2025-06-22 22:39:51 +00:00
Viktor Barzin
68d88de464
disable kubectl port forwarding and instead rely on a docker contaier for redis 2025-06-22 21:33:02 +00:00
Viktor Barzin
9a164ddfdc
migrate frontend to use new celery api and improve ux around spinners whilst loading 2025-06-22 21:32:46 +00:00
Viktor Barzin
1ad8a12f3d
add start.sh for backend as we need to start multiple services now 2025-06-22 21:19:19 +00:00
Viktor Barzin
93129333e6
migrate background tasks to celery 2025-06-22 21:18:52 +00:00
Viktor Barzin
efe3248c07
migrate to using db connection string from env 2025-06-22 21:16:55 +00:00
Viktor Barzin
84a55eefde
add default dir path for image dumps 2025-06-22 21:15:50 +00:00
Viktor Barzin
3d024277fb
add uvicorn logger when dumping listings 2025-06-22 21:15:35 +00:00
Viktor Barzin
24b41ae2ed
add celery env variables to sample env 2025-06-22 21:15:15 +00:00
Viktor Barzin
069969c14a
bugfix - remove trailing slash in authentik config which was causing an additional request that was always redirected 2025-06-22 14:25:43 +00:00
Viktor Barzin
744fa7b8a7
use the uvicorn logger; also update dockerfile to run migrations as parto f startup instead of when starting uvicorn 2025-06-22 14:00:47 +00:00
Viktor Barzin
684af9a040
add helpful adb commands to the readme 2025-06-22 13:06:37 +00:00
Viktor Barzin
bf79d3c977
convert district at the last moment - when we send the query 2025-06-22 13:05:53 +00:00
Viktor Barzin
bcece4500a
set debug level to debug 2025-06-22 13:05:24 +00:00
Viktor Barzin
9eae30b0d6
bugfix - pages start from 1 2025-06-22 13:04:10 +00:00
Viktor Barzin
03d24aff99
refactor dump listings to extract all pages with data 2025-06-22 12:43:24 +00:00
Viktor Barzin
fbd39bb67f
replace available from component with a nicer search which takes human input 2025-06-21 23:46:19 +00:00
Viktor Barzin
ce199152e2
add available from filter 2025-06-21 23:22:11 +00:00
Viktor Barzin
8c65aa0916
add logger for more strucutred logging in python 2025-06-21 22:38:30 +00:00
Viktor Barzin
1f04753250
fix typoe in drone config when restarting the deployments 2025-06-21 21:58:58 +00:00
Viktor Barzin
a73eea4d9e
run alembic migrations on startup 2025-06-21 21:52:51 +00:00
Viktor Barzin
2f8adb99e8
byt github actions - youre too expensive for private repos and my awesome drone ci caching is working nicely 2025-06-21 20:13:50 +00:00
Viktor Barzin
519e5f384a
upgrade some poetry files 2025-06-21 20:10:30 +00:00
Viktor Barzin
97e3fb9e4e
cache from in drone with tag 2025-06-21 19:59:30 +00:00
Viktor Barzin
7a21a032b7
remove image tag for caching in drone 2025-06-21 18:52:13 +00:00
Viktor Barzin
170ab33eee
add ts ignore for errors 2025-06-21 18:51:06 +00:00
Viktor Barzin
41ef6400da
use cache for immoweb image 2025-06-21 18:49:31 +00:00
Viktor Barzin
81683ce73b
update dronce ci to built on top of previous image for api 2025-06-21 18:20:43 +00:00
Viktor Barzin
af6c15a231
add github action to build the api image 2025-06-21 18:12:35 +00:00
Viktor Barzin
8d32c2cbd7
add filter for last seen days 2025-06-21 17:39:10 +00:00
Viktor Barzin
b1cbe8505a
handle errors better in the ui with an alert component 2025-06-21 17:26:45 +00:00
Viktor Barzin
5bd4562205
setup boilerplate for creating background workers and add 1 for dumping listings 2025-06-21 17:25:56 +00:00
Viktor Barzin
4e4a5ece15
start coroutine from the thread instead of the wrapper normal func 2025-06-21 13:48:28 +00:00
Viktor Barzin
064f2651d5
set 30m timeout to drone builds 2025-06-21 12:50:31 +00:00
Viktor Barzin
a7e0773c0a
add worker api to refresh data in the background 2025-06-21 12:49:04 +00:00
Viktor Barzin
fc722b6b5f
do 1 attempt to detect sqm from floorplan. if that fails then set to 0 instead of returning none 2025-06-21 12:06:57 +00:00
Viktor Barzin
4e13dbdb7f
retry transient errors from rightmove when fetching images 2025-06-21 12:06:19 +00:00