Commit graph

  • c660771225
    change api port to 5001 Viktor Barzin 2025-06-24 19:12:20 +00:00
  • 8ab79b7c72
    squash parametrs form to take less space Viktor Barzin 2025-06-23 21:16:07 +00:00
  • a526f81517
    add api endpoint for getting all available districts Viktor Barzin 2025-06-23 21:09:03 +00:00
  • e05b4788e0
    show spinner while running backgroun task Viktor Barzin 2025-06-23 19:45:53 +00:00
  • 5a9a837b27
    handle serialization of result more generically - if we cannot json dumps, then return string representation Viktor Barzin 2025-06-23 19:45:31 +00:00
  • a0d099e62b
    expiry tasks after 10 minutes; also handle expired tasks Viktor Barzin 2025-06-23 19:43:54 +00:00
  • 7cea586f41
    update start sh to work with environemtns and update dockerfile to use it to start all needed services Viktor Barzin 2025-06-23 19:01:31 +00:00
  • 5610f1d868
    remove deleted import for worker Viktor Barzin 2025-06-22 22:39:51 +00:00
  • 68d88de464
    disable kubectl port forwarding and instead rely on a docker contaier for redis Viktor Barzin 2025-06-22 21:33:02 +00:00
  • 9a164ddfdc
    migrate frontend to use new celery api and improve ux around spinners whilst loading Viktor Barzin 2025-06-22 21:20:42 +00:00
  • 1ad8a12f3d
    add start.sh for backend as we need to start multiple services now Viktor Barzin 2025-06-22 21:19:19 +00:00
  • 93129333e6
    migrate background tasks to celery Viktor Barzin 2025-06-22 21:18:52 +00:00
  • efe3248c07
    migrate to using db connection string from env Viktor Barzin 2025-06-22 21:16:55 +00:00
  • 84a55eefde
    add default dir path for image dumps Viktor Barzin 2025-06-22 21:15:50 +00:00
  • 3d024277fb
    add uvicorn logger when dumping listings Viktor Barzin 2025-06-22 21:15:30 +00:00
  • 24b41ae2ed
    add celery env variables to sample env Viktor Barzin 2025-06-22 21:15:15 +00:00
  • 069969c14a
    bugfix - remove trailing slash in authentik config which was causing an additional request that was always redirected Viktor Barzin 2025-06-22 14:25:43 +00:00
  • 744fa7b8a7
    use the uvicorn logger; also update dockerfile to run migrations as parto f startup instead of when starting uvicorn Viktor Barzin 2025-06-22 14:00:47 +00:00
  • 684af9a040
    add helpful adb commands to the readme Viktor Barzin 2025-06-22 13:06:37 +00:00
  • bf79d3c977
    convert district at the last moment - when we send the query Viktor Barzin 2025-06-22 13:05:53 +00:00
  • bcece4500a
    set debug level to debug Viktor Barzin 2025-06-22 13:05:24 +00:00
  • 9eae30b0d6
    bugfix - pages start from 1 Viktor Barzin 2025-06-22 13:04:10 +00:00
  • 03d24aff99
    refactor dump listings to extract all pages with data Viktor Barzin 2025-06-22 12:43:24 +00:00
  • fbd39bb67f
    replace available from component with a nicer search which takes human input Viktor Barzin 2025-06-21 23:43:35 +00:00
  • ce199152e2
    add available from filter Viktor Barzin 2025-06-21 23:22:11 +00:00
  • 8c65aa0916
    add logger for more strucutred logging in python Viktor Barzin 2025-06-21 22:35:32 +00:00
  • 1f04753250
    fix typoe in drone config when restarting the deployments Viktor Barzin 2025-06-21 21:58:58 +00:00
  • a73eea4d9e
    run alembic migrations on startup Viktor Barzin 2025-06-21 21:52:51 +00:00
  • 2f8adb99e8
    byt github actions - youre too expensive for private repos and my awesome drone ci caching is working nicely Viktor Barzin 2025-06-21 20:13:50 +00:00
  • 519e5f384a
    upgrade some poetry files Viktor Barzin 2025-06-21 20:10:30 +00:00
  • 97e3fb9e4e
    cache from in drone with tag Viktor Barzin 2025-06-21 19:59:30 +00:00
  • 7a21a032b7
    remove image tag for caching in drone Viktor Barzin 2025-06-21 18:52:13 +00:00
  • 170ab33eee
    add ts ignore for errors Viktor Barzin 2025-06-21 18:51:06 +00:00
  • 41ef6400da
    use cache for immoweb image Viktor Barzin 2025-06-21 18:49:31 +00:00
  • 81683ce73b
    update dronce ci to built on top of previous image for api Viktor Barzin 2025-06-21 18:20:43 +00:00
  • af6c15a231
    add github action to build the api image Viktor Barzin 2025-06-21 17:59:19 +00:00
  • 8d32c2cbd7
    add filter for last seen days Viktor Barzin 2025-06-21 17:39:10 +00:00
  • b1cbe8505a
    handle errors better in the ui with an alert component Viktor Barzin 2025-06-21 17:26:45 +00:00
  • 5bd4562205
    setup boilerplate for creating background workers and add 1 for dumping listings Viktor Barzin 2025-06-21 17:25:56 +00:00
  • 4e4a5ece15
    start coroutine from the thread instead of the wrapper normal func Viktor Barzin 2025-06-21 13:48:28 +00:00
  • 064f2651d5
    set 30m timeout to drone builds Viktor Barzin 2025-06-21 12:50:31 +00:00
  • a7e0773c0a
    add worker api to refresh data in the background Viktor Barzin 2025-06-21 12:49:04 +00:00
  • fc722b6b5f
    do 1 attempt to detect sqm from floorplan. if that fails then set to 0 instead of returning none Viktor Barzin 2025-06-21 12:06:57 +00:00
  • 4e13dbdb7f
    retry transient errors from rightmove when fetching images Viktor Barzin 2025-06-21 12:04:48 +00:00
  • ec2e0dded8
    add method to dump all data for listings e2e Viktor Barzin 2025-06-21 12:04:31 +00:00
  • 3e1be6750c
    add filter for sqm Viktor Barzin 2025-06-18 21:05:38 +00:00
  • 70460bee5d
    add filter for min and max price Viktor Barzin 2025-06-18 20:57:20 +00:00
  • dadb56aa16
    add filter for min and max number of bedrooms Viktor Barzin 2025-06-18 20:54:47 +00:00
  • 69d15e9a16
    add support for querying buying listings as well as by max price Viktor Barzin 2025-06-18 20:38:50 +00:00
  • ba4a95825b
    reset the map when new parameters are chosen Viktor Barzin 2025-06-18 19:12:00 +00:00
  • 7c70da4bed hook up query parameters form with rest query Viktor Barzin 2025-06-18 18:56:02 +00:00
  • 3574df8ae0 removing decisions from the repo Kadir 2025-06-18 00:59:16 +01:00
  • 1caaa247d8
    paameterize form using zod to get a type checked fields Viktor Barzin 2025-06-17 20:42:41 +00:00
  • a092b4e9c8
    disable login button whilst logging in Viktor Barzin 2025-06-17 19:15:18 +00:00
  • 7ae822f115
    trigger ci only on daily cron instead of on every push Viktor Barzin 2025-06-17 19:10:49 +00:00
  • 92c1ee76f5
    add pipeline to build the backend api Viktor Barzin 2025-06-17 18:56:52 +00:00
  • 76e7338ab9
    add context dir to the drone.yml Viktor Barzin 2025-06-17 18:51:23 +00:00
  • 0bee75fd71
    add drone ci config Viktor Barzin 2025-06-17 18:45:28 +00:00
  • 5fb8216b88
    ignore all of data dir Viktor Barzin 2025-06-16 22:45:07 +00:00
  • b72569b6b9
    make the app buildable for prod Viktor Barzin 2025-06-16 22:43:46 +00:00
  • 1e868f1b0d
    do not typescript check map.tsx as that has a lot of the legacy js code that is not typed Viktor Barzin 2025-06-16 22:42:32 +00:00
  • 10a997a8a1
    make oauth redirect url depends on env mode Viktor Barzin 2025-06-16 22:42:06 +00:00
  • e598a02670
    add crossfilter2 do deps as aparently it is not part of types/crossfilter2 Viktor Barzin 2025-06-16 22:41:11 +00:00
  • cd2d39c3b0
    add dockerignore to ignore frontend as that is built separately Viktor Barzin 2025-06-16 22:40:36 +00:00
  • 8e41032c6c
    setup map component to render correctly and visualize all listings in scrollable components Viktor Barzin 2025-06-15 21:06:10 +00:00
  • a8ee95b9d9
    install shadcdn and move login dialog to a separate component Viktor Barzin 2025-06-15 13:49:34 +00:00
  • 4c7fe8927b
    add minimal working version where we fetch data and visualize it corectly Viktor Barzin 2025-06-15 12:48:52 +00:00
  • b995bc2286
    add api endpoint for geojson data fetching Viktor Barzin 2025-06-15 12:42:56 +00:00
  • 7602c3762b
    properly ignore caddy dev dir Viktor Barzin 2025-06-15 12:42:23 +00:00
  • 0dc6a30dbd
    fail start script if caddy is not installed Viktor Barzin 2025-06-14 15:52:27 +00:00
  • 1b97cf0dc3
    exclude caddy files Viktor Barzin 2025-06-14 15:45:16 +00:00
  • c7d996dbeb
    rename frontend directory to frontend Viktor Barzin 2025-06-14 15:43:14 +00:00
  • 71a9b69e04
    do not include caddy dev dir in repo as that is generated Viktor Barzin 2025-06-14 15:39:16 +00:00
  • aca76111f0
    add react vite app with oidc support and configured api calls to api Viktor Barzin 2025-06-14 15:36:38 +00:00
  • ff2f141b75
    allow limiting the number of listings fetched Viktor Barzin 2025-06-14 13:39:56 +00:00
  • 9b03ab83d2
    setup fastapi auth using authentik instance Viktor Barzin 2025-06-14 13:39:37 +00:00
  • 4ad04775c9
    add user auth boilerplate Viktor Barzin 2025-06-11 21:08:11 +00:00
  • 4a65664f4a
    add fastapi endpoint + deps + update dockerfile to run service instead Viktor Barzin 2025-06-11 20:05:26 +00:00
  • 45af54e4e4
    do not ignore data directory, just the contents; allows creating the sqlite db inside Viktor Barzin 2025-06-09 22:08:01 +00:00
  • 073020c6d2
    reduce size of json by pulling interesting fields above instead of relying on the entire thing Viktor Barzin 2025-06-09 21:31:15 +00:00
  • 296a4e7603
    bugfix fetching transactions to make use of db cache Viktor Barzin 2025-06-09 21:23:54 +00:00
  • 9b2653ce91
    add tenacity to retry transient blockouts by rightmove Viktor Barzin 2025-06-08 20:59:04 +00:00
  • 289206afc0
    some cleanups Viktor Barzin 2025-06-08 20:58:28 +00:00
  • 831c45e1f5
    use cached data when fetching details Viktor Barzin 2025-06-08 18:23:25 +00:00
  • 3785d01009
    migrate immoweb exporter to use models Viktor Barzin 2025-06-08 18:18:38 +00:00
  • e317d2ec54
    use query params to filter out models; also make csv exporter work with models Viktor Barzin 2025-06-08 17:01:33 +00:00
  • 80c335ba04
    migrate routing command to use the models and store data there Viktor Barzin 2025-06-08 11:45:05 +00:00
  • 325823e631
    refactor detect floorplan to use model listings Viktor Barzin 2025-06-07 14:30:32 +00:00
  • ba87d07cd2
    migrate dump images command to use model listings Viktor Barzin 2025-06-07 13:56:00 +00:00
  • 4f5a934fa9
    refactor dump listings to start using model instead of the data_access object Viktor Barzin 2025-06-07 12:46:53 +00:00
  • 842f7cefbe
    merge dump listings and dump details commands - fetch both details and listings in the same command Viktor Barzin 2025-06-07 12:00:23 +00:00
  • 29213f3d26
    refactor the semaphore when dumping listings Viktor Barzin 2025-06-06 20:08:38 +00:00
  • b7a2ea75aa
    add json field to store any additional blob of data that may be missing; also populate db when dumping listings Viktor Barzin 2025-06-06 19:57:50 +00:00
  • 8b2025e700
    add command to dump existing listing from fs to db Viktor Barzin 2025-06-04 21:56:26 +00:00
  • f7fb891648
    add models Viktor Barzin 2025-06-04 21:09:29 +00:00
  • bc5c258170
    add robots.txt Viktor Barzin 2025-06-04 20:50:50 +00:00
  • e50f33ed14
    filter out for furnished properties only Viktor Barzin 2025-06-03 20:02:29 +00:00
  • 0d3393ed94
    add sqlmodel + alembic + setup models skeleton to slowly enable transition towards a db Viktor Barzin 2025-06-03 20:00:30 +00:00
  • 8c646a5322
    touch geojson file to ensure it exists before opening to write Viktor Barzin 2025-06-01 22:13:22 +00:00
  • 16b88c4aac
    remove unused torch pkg as that was consuming 12gb of the container img Viktor Barzin 2025-06-01 20:31:50 +00:00