Commit graph

10 commits

Author SHA1 Message Date
Viktor Barzin
5514fa6381 Remove 1000-result limit, add Redis caching and virtual scrolling
- Remove hard-coded limit=1000 default from listing_geojson and streaming
  endpoints, allowing all matching results to be returned
- Add Redis caching service (db=2, 30min TTL) that caches query results
  as Redis Lists for fast re-queries with reduced DB load
- Integrate cache into streaming endpoint: serve from cache on hit,
  populate cache on miss during DB streaming
- Invalidate cache after scrape completes (both success and no-new-listings)
- Replace ScrollArea with react-virtuoso in ListView for virtual scrolling,
  keeping only ~20-30 DOM nodes regardless of list size
- Handle metadata streaming message to show "0 / N" progress from start
- Throttle frontend state updates with requestAnimationFrame to prevent
  UI jank from rapid re-renders during cached response streaming
2026-02-06 20:47:36 +00:00
Viktor Barzin
ce199152e2
add available from filter 2025-06-21 23:22:11 +00:00
Viktor Barzin
b1cbe8505a
handle errors better in the ui with an alert component 2025-06-21 17:26:45 +00:00
Viktor Barzin
a7e0773c0a
add worker api to refresh data in the background 2025-06-21 12:49:04 +00:00
Viktor Barzin
1caaa247d8
paameterize form using zod to get a type checked fields 2025-06-17 20:42:41 +00:00
Viktor Barzin
e598a02670
add crossfilter2 do deps as aparently it is not part of types/crossfilter2 2025-06-16 22:41:11 +00:00
Viktor Barzin
8e41032c6c
setup map component to render correctly and visualize all listings in scrollable components 2025-06-15 21:06:10 +00:00
Viktor Barzin
a8ee95b9d9
install shadcdn and move login dialog to a separate component 2025-06-15 13:49:34 +00:00
Viktor Barzin
4c7fe8927b
add minimal working version where we fetch data and visualize it corectly 2025-06-15 12:48:52 +00:00
Viktor Barzin
c7d996dbeb
rename frontend directory to frontend 2025-06-14 15:43:14 +00:00
Renamed from crawler/wrongmove/package.json (Browse further)