Skip to content

Deliver critical requests independently of Telegram #440

Open

Description

@spalen0

Epic: #437

Outcome

a CRITICAL incident has reliable emergency delivery even when Telegram is unavailable
or an earlier HIGH alert was dispatched.

Scope

  • Persist emergency and notification delivery jobs independently for the same incident.
  • Send signed requests with stable action IDs and retry transient HTTP failures.
  • Distinguish durable acceptance from action success; track the executor's terminal result.
  • Replace the shared HIGH/CRITICAL cooldown as an emergency-suppression mechanism with explicit
    incident/action deduplication. A HIGH dispatch cannot suppress escalation to CRITICAL.
  • Keep alert history, routing, and the existing protocol allowlist as shared behavior rather
    than building an independent emergency path specifically for siUSD.

Acceptance criteria

Telegram failure, HIGH then CRITICAL, duplicate delivery, executor unavailability,
and sender restart are covered, and pending work/results remain visible and recoverable.

Dependencies

Coordinate the request/action ID and status contract with https://github.com/tapired/liquidity-monitoring/issues/452 before implementation; integration completion is blocked by that issue.

Related work

Include relevant behavior/failure tests and operational documentation in the implementation. Update monitoring metadata when monitor behavior changes.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions