The IMAP cronjob re-processes the full mailbox window on every run, so on steady-state runs all activities come back tagged duplicate=N. The existing logic raises ImportValidationError whenever imported_n < total_n, which makes the cron exit 1 (and the Job is reported FAILED) even though the data path is healthy. Treat (imported + duplicates) as "accounted for". Only raise when rows go missing entirely (silently dropped / validation rejected). Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| providers | ||
| sinks | ||
| __init__.py | ||
| cli.py | ||
| dedup.py | ||
| fx.py | ||
| fx_ecb.py | ||
| metrics.py | ||
| models.py | ||
| normaliser.py | ||
| pipeline.py | ||