Increased level of errors for workflow automation and Podio webhooks delays

Incident Report for Podio Status Page

Resolved

Today August 1st, we experienced issues as a part of a release update for Podio workflow automation starting around 8.55 EST (14.55 CET). We noticed increased errors and reports from customers seeing new errors in workflow logs and worked on a fix and roll-back. We saw reduced errors from 9.20 EST (15.20 CET) after the initial fix and later rolled back the full release to ensure better quality of the upgrades. In addition to the increased workflow automation errors, we saw delay for Podio webhooks execution slowing down integrations and automations. Team is working to review the cause of the events and ensure we put better safeguards in place for similar releases and future upgrades. We are very sorry for the inconvenience and sending extra love to the workflow admins who had to review and clean up new errors in logs due this morning's release.

Posted 2 years ago. Aug 01, 2023 - 09:00 EDT