Commit graph

Select branches

Hide pull requests

master

Mono Color

• 3588139201 Add runtime artifacts to .gitignore master Viktor Barzin 2026-02-06 21:04:08 +00:00
• d205d15c74 Add services layer, tests, streaming UI, and cleanup legacy code Viktor Barzin 2026-02-06 20:55:10 +00:00
• 5514fa6381 Remove 1000-result limit, add Redis caching and virtual scrolling Viktor Barzin 2026-02-06 20:34:50 +00:00
• c4b11ccfe9 Add comprehensive logging to Celery tasks and listing processor Viktor Barzin 2026-02-02 23:01:13 +00:00
• f880664a98 Add throttling detection and circuit breaker for Rightmove scraper Viktor Barzin 2026-02-02 22:50:19 +00:00
• e8293c6042 Add intelligent query splitting to maximize Rightmove data extraction Viktor Barzin 2026-02-02 21:57:45 +00:00
• 29ba739063
  Improve login UI with error handling and callback page Viktor Barzin 2026-02-02 20:08:03 +00:00
• ceb943f198 Fix refresh listings returning immediate success with no progress Viktor Barzin 2026-02-01 22:30:04 +00:00
• 4b1e971edf
  delete detect floorplan as it was renamed Viktor Barzin 2026-02-01 21:54:15 +00:00
• 22aa9c86a7
  update drone.yaml to build on push Viktor Barzin 2026-02-01 21:53:18 +00:00
• f88bba032f
  Test without secret Viktor Barzin 2026-02-01 20:55:59 +00:00
• dc1186601a Final webhook test Viktor Barzin 2026-02-01 20:54:53 +00:00
• fe01df0e7e
  delete dump images as it is renamed Viktor Barzin 2026-02-01 20:52:23 +00:00
• 4969df8745 Test new webhook Viktor Barzin 2026-02-01 20:51:13 +00:00
• ccef50b371 Trigger webhook Viktor Barzin 2026-02-01 20:47:50 +00:00
• 1680cda7b7 Test webhook with secret Viktor Barzin 2026-02-01 20:45:52 +00:00
• 835a2a9d53 Fix stuck Celery tasks and add purge all tasks functionality Viktor Barzin 2026-02-01 20:40:07 +00:00
• 93f7f57de3 Trigger build test Viktor Barzin 2026-02-01 20:29:56 +00:00
• 6d17d2ccad Fix Drone CI trigger to allow push events Viktor Barzin 2026-02-01 20:25:32 +00:00
• 61e1832bc1
  delete 1 dump listings as it is renamed Viktor Barzin 2026-02-01 20:23:18 +00:00
• 4d7ca7b920
  update dockerignore Viktor Barzin 2026-02-01 20:22:03 +00:00
• 997084d0f2 Trigger CI build test Viktor Barzin 2026-02-01 20:18:35 +00:00
• 3f427b062c Test push trigger Viktor Barzin 2026-02-01 20:03:53 +00:00
• aad9bdd950 Add push trigger to Drone CI pipeline Viktor Barzin 2026-02-01 19:56:00 +00:00
• 218781e038 Add visual progress bar to task indicator Viktor Barzin 2026-02-01 19:23:27 +00:00
• 0ca955796e Show processed/total counts in task progress indicator Viktor Barzin 2026-02-01 19:19:59 +00:00
• 6d8f69610f Add proper buy listing support with type-aware UI filters and display Viktor Barzin 2026-02-01 19:13:29 +00:00
• c7ac448f15 Add configurable scheduling, UI health/task indicators, and auto-load map with default filters Viktor Barzin 2026-02-01 17:28:37 +00:00
• 1c8c3e4657
  add alembic mutation for logitute name Viktor Barzin 2026-01-28 21:00:46 +00:00
• ced9a153bd
  replace pymysql with mysqlclient as it is "better"; also fix an issue in the ui exporter that had wrong imports Viktor Barzin 2025-10-18 09:58:55 +00:00
• 0801aaf200
  More ruff fixes (#2) Kadir 2025-09-14 19:44:03 +01:00
• 4c23acdb55
  adding ruff auto check for pull requests as well as fixing all ruff errors (#1) Kadir 2025-09-14 19:40:18 +01:00
• b1e0a414cf Used ruff to cleanup Kadir 2025-09-14 19:02:30 +01:00
• 8d11e4a81c Fix deps and move to a better local environment Kadir 2025-09-14 18:58:19 +01:00
• 520286aaee
  update readme with instructions on how to run everything Viktor Barzin 2025-08-28 21:39:20 +00:00
• 62329a2eb4
  add redis container in start.sh in case it is not running in dev mode Viktor Barzin 2025-08-28 20:48:42 +00:00
• ff57117054
  do not watch files with uvicorn as the datadir is quite big and monitor is very very slow Viktor Barzin 2025-08-23 22:36:57 +00:00
• 526f4fc0c3
  update last seen property when processing listings to refresh data Viktor Barzin 2025-08-23 22:36:37 +00:00
• 480957dc72
  add timeout when fetching details and use new entrypoint for task processing Viktor Barzin 2025-08-23 22:20:42 +00:00
• e5c68f6bb7
  add opentelemetry Viktor Barzin 2025-08-02 17:25:56 +00:00
• d1cef99c5a
  make task processing a bit better. still doing 1 query to check if needs processing; will fix later Viktor Barzin 2025-07-27 20:09:41 +00:00
• 87efe0694c
  format progress to 2 digits and add status updates before starting Viktor Barzin 2025-07-27 18:47:09 +00:00
• 91a0436f7f
  migrate processing to a pipeline approach where each listing is processed in a pipeline in parallel and status reported back to track progress Viktor Barzin 2025-07-27 18:33:39 +00:00
• 4fa09e31c8
  make property image clickable Viktor Barzin 2025-07-27 11:11:04 +00:00
• 42ed20b833
  read slack notification webhook url from env Viktor Barzin 2025-07-26 13:15:21 +00:00
• 4e7734d327
  add healtcheck api endpoint Viktor Barzin 2025-07-26 13:06:28 +00:00
• 206471cee8
  fix argument error in tasks Viktor Barzin 2025-07-26 10:38:51 +00:00
• 272d54d014
  add daily scrape of interesting rent listings Viktor Barzin 2025-07-25 22:14:45 +00:00
• 762408e054
  add apprise and send notification when refreshing listings Viktor Barzin 2025-07-25 21:32:06 +00:00
• ce386e748d
  default to last seen 28 days from 7 Viktor Barzin 2025-07-15 18:52:25 +00:00
• c98f6ff97f
  hack - add available from parameter only for rent listings Viktor Barzin 2025-07-06 12:18:32 +00:00
• d4b22deda0
  save user queries in redis so that user can refresh the page and still come back to their latest task Viktor Barzin 2025-07-06 12:02:25 +00:00
• a055c92dea
  split listing query into multiple subqueries to avoid hittign the 1.5k rightmove limit Viktor Barzin 2025-07-06 12:00:12 +00:00
• 241b8d1842
  bugfix fetching prices for buy listings Viktor Barzin 2025-07-06 11:48:36 +00:00
• db85cf2d3a
  be more explicit with what the parameter submit buttons do Viktor Barzin 2025-07-04 23:10:43 +00:00
• 7c43907c2f
  welcome email as not all users have given names Viktor Barzin 2025-07-01 16:26:52 +00:00
• 20ff91d663
  reduce concurrency when fetching images + add retries Viktor Barzin 2025-07-01 16:12:06 +00:00
• 59c33428c2
  bugfix - reraise the error when getting 429 so that we retry later Viktor Barzin 2025-06-30 23:24:16 +00:00
• a84dcc0588
  bugfix - print sql statemnts only in dev Viktor Barzin 2025-06-30 23:22:12 +00:00
• 3a4fbdf99a
  run migrations as part of prod run Viktor Barzin 2025-06-30 23:14:30 +00:00
• 5adffc8dcf
  make a few columns in the listing model indices to help with search Viktor Barzin 2025-06-30 22:57:41 +00:00
• 92c8403157
  add subtitle to the login modal with instructions on how to get invited Viktor Barzin 2025-06-30 22:39:10 +00:00
• c660771225
  change api port to 5001 Viktor Barzin 2025-06-24 19:12:20 +00:00
• 8ab79b7c72
  squash parametrs form to take less space Viktor Barzin 2025-06-23 21:16:07 +00:00
• a526f81517
  add api endpoint for getting all available districts Viktor Barzin 2025-06-23 21:09:03 +00:00
• e05b4788e0
  show spinner while running backgroun task Viktor Barzin 2025-06-23 19:45:53 +00:00
• 5a9a837b27
  handle serialization of result more generically - if we cannot json dumps, then return string representation Viktor Barzin 2025-06-23 19:45:31 +00:00
• a0d099e62b
  expiry tasks after 10 minutes; also handle expired tasks Viktor Barzin 2025-06-23 19:43:54 +00:00
• 7cea586f41
  update start sh to work with environemtns and update dockerfile to use it to start all needed services Viktor Barzin 2025-06-23 19:01:31 +00:00
• 5610f1d868
  remove deleted import for worker Viktor Barzin 2025-06-22 22:39:51 +00:00
• 68d88de464
  disable kubectl port forwarding and instead rely on a docker contaier for redis Viktor Barzin 2025-06-22 21:33:02 +00:00
• 9a164ddfdc
  migrate frontend to use new celery api and improve ux around spinners whilst loading Viktor Barzin 2025-06-22 21:20:42 +00:00
• 1ad8a12f3d
  add start.sh for backend as we need to start multiple services now Viktor Barzin 2025-06-22 21:19:19 +00:00
• 93129333e6
  migrate background tasks to celery Viktor Barzin 2025-06-22 21:18:52 +00:00
• efe3248c07
  migrate to using db connection string from env Viktor Barzin 2025-06-22 21:16:55 +00:00
• 84a55eefde
  add default dir path for image dumps Viktor Barzin 2025-06-22 21:15:50 +00:00
• 3d024277fb
  add uvicorn logger when dumping listings Viktor Barzin 2025-06-22 21:15:30 +00:00
• 24b41ae2ed
  add celery env variables to sample env Viktor Barzin 2025-06-22 21:15:15 +00:00
• 069969c14a
  bugfix - remove trailing slash in authentik config which was causing an additional request that was always redirected Viktor Barzin 2025-06-22 14:25:43 +00:00
• 744fa7b8a7
  use the uvicorn logger; also update dockerfile to run migrations as parto f startup instead of when starting uvicorn Viktor Barzin 2025-06-22 14:00:47 +00:00
• 684af9a040
  add helpful adb commands to the readme Viktor Barzin 2025-06-22 13:06:37 +00:00
• bf79d3c977
  convert district at the last moment - when we send the query Viktor Barzin 2025-06-22 13:05:53 +00:00
• bcece4500a
  set debug level to debug Viktor Barzin 2025-06-22 13:05:24 +00:00
• 9eae30b0d6
  bugfix - pages start from 1 Viktor Barzin 2025-06-22 13:04:10 +00:00
• 03d24aff99
  refactor dump listings to extract all pages with data Viktor Barzin 2025-06-22 12:43:24 +00:00
• fbd39bb67f
  replace available from component with a nicer search which takes human input Viktor Barzin 2025-06-21 23:43:35 +00:00
• ce199152e2
  add available from filter Viktor Barzin 2025-06-21 23:22:11 +00:00
• 8c65aa0916
  add logger for more strucutred logging in python Viktor Barzin 2025-06-21 22:35:32 +00:00
• 1f04753250
  fix typoe in drone config when restarting the deployments Viktor Barzin 2025-06-21 21:58:58 +00:00
• a73eea4d9e
  run alembic migrations on startup Viktor Barzin 2025-06-21 21:52:51 +00:00
• 2f8adb99e8
  byt github actions - youre too expensive for private repos and my awesome drone ci caching is working nicely Viktor Barzin 2025-06-21 20:13:50 +00:00
• 519e5f384a
  upgrade some poetry files Viktor Barzin 2025-06-21 20:10:30 +00:00
• 97e3fb9e4e
  cache from in drone with tag Viktor Barzin 2025-06-21 19:59:30 +00:00
• 7a21a032b7
  remove image tag for caching in drone Viktor Barzin 2025-06-21 18:52:13 +00:00
• 170ab33eee
  add ts ignore for errors Viktor Barzin 2025-06-21 18:51:06 +00:00
• 41ef6400da
  use cache for immoweb image Viktor Barzin 2025-06-21 18:49:31 +00:00
• 81683ce73b
  update dronce ci to built on top of previous image for api Viktor Barzin 2025-06-21 18:20:43 +00:00
• af6c15a231
  add github action to build the api image Viktor Barzin 2025-06-21 17:59:19 +00:00
• 8d32c2cbd7
  add filter for last seen days Viktor Barzin 2025-06-21 17:39:10 +00:00
• b1cbe8505a
  handle errors better in the ui with an alert component Viktor Barzin 2025-06-21 17:26:45 +00:00