Happy path
Open Email Deliverability from Reports.
The report can aggregate per mailing or across the event.
Inspect status counts.
Delivered, opened, clicked, bounced, and suppressed counts use the ui-status-pill registry.
Generate export.
The async job tracker shows progress until the deliverability artifact is ready.
Failure modes
Email status count mismatch
Trigger: totals do not reconcile across delivered/opened/clicked/bounced/suppressed.
Resolution: summary flags inconsistent aggregation before export.
Mailing/event aggregation ambiguity
Trigger: per-mailing filters leak event-level rows.
Resolution: aggregation mode is explicit in the preview and export digest.
Status registry missing value
Trigger: suppressed or bounced renders as an unknown raw string.
Resolution: ui-status-pill registry covers all deliverability states.
Deployed-runtime gap
Trigger: deployed run on 2026-04-29 observed email-deliverability report job create returned 400 D1 bootstrap error; the probe locks this in until the gap is closed.
Resolution: status 400 remains expected until deployed D1 bootstrap is fixed.
Stable test attributes
Visibility teeth. Each attribute must be effectively visible when active.
email-deliverability-report-page | Page | Email deliverability report surface |
email-deliverability-aggregation-mode | Form | Per-mailing or per-event mode |
email-deliverability-mailing-picker | Form | Mailing selector |
email-deliverability-status-summary | Preview | Delivered/opened/clicked/bounced/suppressed counts |
email-deliverability-status-pill | Preview | Status display registry |
email-deliverability-generate-cta | Toolbar | Create report job |
email-deliverability-job-tracker | Page | Async report lifecycle |
email-deliverability-download-cta | Job row | Download artifact |
email-deliverability-regenerate-cta | Job row | Regenerate expired/swept artifact |
email-deliverability-error-panel | Job row | Failure reason and request id |
email-deliverability-stuck-banner | Job row | Queued too long warning |
email-deliverability-permission-gate | Catalog | Permission-filtered report entry |
email-deliverability-gap-panel | Page | Runtime gap notice |
Agent test plan
- email-deliverability-renders
- generate-email-deliverability-report
- status-pill-registry-covers-email-events
- deployed-runtime-gap