Previous incidents

This incident has been resolved.

Clients should now be able to generate TNT cons and manifest.
Carrier has confirmed the issue is fixed.

Postmortem:

Yesterday, we made some code changes to adapt to an issue we saw when processing tracking from a particular carrier.

Unfortunately, the effect of that code changes caused the background process that consumes the carrier tracking events to slow down by several orders of magnitude. This morning, once we realised that tracking was not being processed fast enough, we made the changes required to fix that issue, and upon releasing that change, the system sped back up and got through...