Fix deps and move to a better local environment

- Cleaned up some deps and moved them to the dev section
- Moved from mysqlclient to pymysql which is a python native one which does not require the OS to have the correct mysql lib
- Added a podman compose file so we can have all dependencies in one place easily without the need to install redis or a database locally

For podman install
- podman
- podman-compose (do a poetry sync I think?)
- podman-compose up to start the containers
This commit is contained in:
Kadir 2025-09-14 18:58:19 +01:00
parent 520286aaee
commit 8d11e4a81c
3 changed files with 618 additions and 444 deletions

1033
crawler/poetry.lock generated

File diff suppressed because it is too large Load diff