Viktor Barzin
835a2a9d53
Fix stuck Celery tasks and add purge all tasks functionality
2026-02-01 20:40:07 +00:00
Viktor Barzin
61e1832bc1
delete 1 dump listings as it is renamed
2026-02-01 20:23:18 +00:00
Viktor Barzin
4d7ca7b920
update dockerignore
2026-02-01 20:22:03 +00:00
Viktor Barzin
218781e038
Add visual progress bar to task indicator
2026-02-01 19:23:27 +00:00
Viktor Barzin
0ca955796e
Show processed/total counts in task progress indicator
2026-02-01 19:19:59 +00:00
Viktor Barzin
6d8f69610f
Add proper buy listing support with type-aware UI filters and display
2026-02-01 19:13:29 +00:00
Viktor Barzin
c7ac448f15
Add configurable scheduling, UI health/task indicators, and auto-load map with default filters
2026-02-01 17:28:37 +00:00
Viktor Barzin
1c8c3e4657
add alembic mutation for logitute name
2026-01-28 21:00:46 +00:00
Viktor Barzin
ced9a153bd
replace pymysql with mysqlclient as it is "better"; also fix an issue in the ui exporter that had wrong imports
2025-10-18 09:58:55 +00:00
Kadir
0801aaf200
More ruff fixes ( #2 )
...
* adding ruff auto check for pull requests as well as fixing all ruff errors
* More ruff fixes: forgot half of the ruff checks
Forgot to do a git add all :D
---------
Co-authored-by: Kadir <git@k8n.dev>
2025-09-14 19:44:03 +01:00
Kadir
4c23acdb55
adding ruff auto check for pull requests as well as fixing all ruff errors ( #1 )
...
Co-authored-by: Kadir <git@k8n.dev>
2025-09-14 19:40:18 +01:00
Kadir
b1e0a414cf
Used ruff to cleanup
...
I hope it just works right as I cannot test things if they work
2025-09-14 19:02:30 +01:00
Kadir
8d11e4a81c
Fix deps and move to a better local environment
...
- Cleaned up some deps and moved them to the dev section
- Moved from mysqlclient to pymysql which is a python native one which does not require the OS to have the correct mysql lib
- Added a podman compose file so we can have all dependencies in one place easily without the need to install redis or a database locally
For podman install
- podman
- podman-compose (do a poetry sync I think?)
- podman-compose up to start the containers
2025-09-14 19:00:26 +01:00
Viktor Barzin
520286aaee
update readme with instructions on how to run everything
2025-08-28 21:39:20 +00:00
Viktor Barzin
62329a2eb4
add redis container in start.sh in case it is not running in dev mode
2025-08-28 20:48:42 +00:00
Viktor Barzin
ff57117054
do not watch files with uvicorn as the datadir is quite big and monitor is very very slow
2025-08-23 22:36:57 +00:00
Viktor Barzin
526f4fc0c3
update last seen property when processing listings to refresh data
2025-08-23 22:36:37 +00:00
Viktor Barzin
480957dc72
add timeout when fetching details and use new entrypoint for task processing
2025-08-23 22:20:42 +00:00
Viktor Barzin
e5c68f6bb7
add opentelemetry
2025-08-02 17:25:56 +00:00
Viktor Barzin
d1cef99c5a
make task processing a bit better. still doing 1 query to check if needs processing; will fix later
2025-07-27 20:09:41 +00:00
Viktor Barzin
87efe0694c
format progress to 2 digits and add status updates before starting
2025-07-27 18:47:09 +00:00
Viktor Barzin
91a0436f7f
migrate processing to a pipeline approach where each listing is processed in a pipeline in parallel and status reported back to track progress
2025-07-27 18:33:39 +00:00
Viktor Barzin
4fa09e31c8
make property image clickable
2025-07-27 11:11:04 +00:00
Viktor Barzin
42ed20b833
read slack notification webhook url from env
2025-07-26 13:15:21 +00:00
Viktor Barzin
4e7734d327
add healtcheck api endpoint
2025-07-26 13:06:28 +00:00
Viktor Barzin
206471cee8
fix argument error in tasks
2025-07-26 10:38:51 +00:00
Viktor Barzin
272d54d014
add daily scrape of interesting rent listings
2025-07-25 22:14:45 +00:00
Viktor Barzin
762408e054
add apprise and send notification when refreshing listings
2025-07-25 21:32:06 +00:00
Viktor Barzin
ce386e748d
default to last seen 28 days from 7
2025-07-15 18:52:25 +00:00
Viktor Barzin
c98f6ff97f
hack - add available from parameter only for rent listings
2025-07-06 12:18:32 +00:00
Viktor Barzin
d4b22deda0
save user queries in redis so that user can refresh the page and still come back to their latest task
2025-07-06 12:02:25 +00:00
Viktor Barzin
a055c92dea
split listing query into multiple subqueries to avoid hittign the 1.5k rightmove limit
2025-07-06 12:00:12 +00:00
Viktor Barzin
241b8d1842
bugfix fetching prices for buy listings
2025-07-06 11:48:36 +00:00
Viktor Barzin
db85cf2d3a
be more explicit with what the parameter submit buttons do
2025-07-04 23:10:43 +00:00
Viktor Barzin
7c43907c2f
welcome email as not all users have given names
2025-07-01 16:28:56 +00:00
Viktor Barzin
20ff91d663
reduce concurrency when fetching images + add retries
2025-07-01 16:12:06 +00:00
Viktor Barzin
59c33428c2
bugfix - reraise the error when getting 429 so that we retry later
2025-06-30 23:24:16 +00:00
Viktor Barzin
a84dcc0588
bugfix - print sql statemnts only in dev
2025-06-30 23:22:12 +00:00
Viktor Barzin
3a4fbdf99a
run migrations as part of prod run
2025-06-30 23:14:30 +00:00
Viktor Barzin
5adffc8dcf
make a few columns in the listing model indices to help with search
2025-06-30 22:57:41 +00:00
Viktor Barzin
92c8403157
add subtitle to the login modal with instructions on how to get invited
2025-06-30 22:39:37 +00:00
Viktor Barzin
c660771225
change api port to 5001
2025-06-24 19:12:20 +00:00
Viktor Barzin
8ab79b7c72
squash parametrs form to take less space
2025-06-23 21:16:07 +00:00
Viktor Barzin
a526f81517
add api endpoint for getting all available districts
2025-06-23 21:09:03 +00:00
Viktor Barzin
e05b4788e0
show spinner while running backgroun task
2025-06-23 19:45:53 +00:00
Viktor Barzin
5a9a837b27
handle serialization of result more generically - if we cannot json dumps, then return string representation
2025-06-23 19:45:31 +00:00
Viktor Barzin
a0d099e62b
expiry tasks after 10 minutes; also handle expired tasks
2025-06-23 19:43:54 +00:00
Viktor Barzin
7cea586f41
update start sh to work with environemtns and update dockerfile to use it to start all needed services
2025-06-23 19:13:19 +00:00
Viktor Barzin
5610f1d868
remove deleted import for worker
2025-06-22 22:39:51 +00:00
Viktor Barzin
68d88de464
disable kubectl port forwarding and instead rely on a docker contaier for redis
2025-06-22 21:33:02 +00:00
