Remove unused deps and multi-stage Dockerfile with pip

Browse source

Drop transformers, matplotlib, geopy, and diskcache (~560MB) from
dependencies — none are imported in the codebase. Replace single-stage
poetry-based Docker build with a two-stage pip-based build: builder
stage installs into a venv from an exported requirements.txt, runtime
stage copies only the venv and app code. Eliminates poetry from the
image (fixes ARM segfaults) and removes ~200MB of build tools from
the final image.

...

This commit is contained in:

Viktor Barzin 2026-02-07 10:48:22 +00:00

parent c76a7ac028

commit 56a7662b8f

No known key found for this signature in database

GPG key ID: 0EB088298288D958

4 changed files with 1897 additions and 766 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

1874

crawler/requirements.txt Normal file

View file

File diff suppressed because it is too large Load diff