No description
Find a file
Viktor Barzin 500cb576db Remove 1000-result limit, add Redis caching and virtual scrolling
- Remove hard-coded limit=1000 default from listing_geojson and streaming
  endpoints, allowing all matching results to be returned
- Add Redis caching service (db=2, 30min TTL) that caches query results
  as Redis Lists for fast re-queries with reduced DB load
- Integrate cache into streaming endpoint: serve from cache on hit,
  populate cache on miss during DB streaming
- Invalidate cache after scrape completes (both success and no-new-listings)
- Replace ScrollArea with react-virtuoso in ListView for virtual scrolling,
  keeping only ~20-30 DOM nodes regardless of list size
- Handle metadata streaming message to show "0 / N" progress from start
- Throttle frontend state updates with requestAnimationFrame to prevent
  UI jank from rapid re-renders during cached response streaming
2026-02-06 20:34:50 +00:00
.github/workflows adding ruff auto check for pull requests as well as fixing all ruff errors (#1) 2025-09-14 19:40:18 +01:00
crawler Remove 1000-result limit, add Redis caching and virtual scrolling 2026-02-06 20:34:50 +00:00
immoweb reduce size of json by pulling interesting fields above instead of relying on the entire thing 2025-06-09 21:46:33 +00:00
vqa adding ruff auto check for pull requests as well as fixing all ruff errors (#1) 2025-09-14 19:40:18 +01:00
.drone.yml update drone.yaml to build on push 2026-02-01 21:53:18 +00:00
.gitignore ignore all of data dir 2025-06-16 22:45:07 +00:00