Update - We saw elevated response times today between 8:45 - 9:00 AM CET. The system is back to normal now and team is monitoring the same closely.
Apr 16, 04:19 EDT

Update - We believe to have a more clear understanding on the cause of issues this morning CET - they were unfortunately an after-affect of our database maintenance over the weekend. We have made updates today, which we hope will improve experience further tomorrow. We will keep incident open until confirmed and also offer a more detailed post-mortem later this week for the general latency, error rates and search issues experienced on Podio over the last few weeks.
Apr 15, 15:58 EDT

Update - Systems have been back to normal since 10:15 am CET (5:15 am EST). Though we have already made fixes, we will continue to monitor throughout the high load hours today and post an update on the root cause after that.
Apr 15, 06:30 EDT

Update - We continue to monitor the issue and investigate the root cause.
Apr 15, 05:25 EDT

Update - We have made changes to the roll-back plan to optimize performance. However we still continue to see performance degradation. Our hypothesis is that the changes made to the database is taking time to warm up as new queries hit our database in production. We will continue to share updates as we learn more and confirm the root cause.
Apr 15, 04:28 EDT

Update - We continue to investigate the current issue and work on getting the system back to normal.
Apr 15, 03:57 EDT

Update - Team has identified issues as a follow up to the maintenance work conducted this weekend. We had implemented a roll-back and clean-up plan which is causing unexpected issues in production. We are working on improvements on our end.
Apr 15, 03:04 EDT

Update - The load on Podio is increasing and leading to delays. Team is working on fixing the issue. Thank you for your patience.
Apr 15, 02:52 EDT

Update - Podio will be seeing delays for a few minutes right now. Team is taking a follow-up action to the database maintenance performed over the weekend before the high load hours begin for Podio.
Apr 15, 02:36 EDT

Update - We have confirmed time for a bigger maintenance event for Saturday 13th this weekend. Please follow the scheduled maintenance here for more insights: https://status.podio.com/incidents/txrw9ngr6ytf

We will be undergoing a scheduled maintenance to implement database enhancements to improve the general stability and reliability. We expect the maintenance to be completed within 1 hour - Podio will not be available during this time.

We expect Podio to continue to experience small periods with latency this week until maintenance has been completed. We expect improved performance after completion of the maintenance.

Thanks for your patience.
Apr 8, 07:56 EDT

Update - We have been working towards getting ready for a larger maintenance this weekend, in order to resolve the general performance issues you have seen on Podio over the last few weeks. Unfortunately, the work being prepared in our backend is not processing fast enough for us to be ready this weekend. We will therefore schedule maintenance in the weekend of April 13-14. A scheduled maintenance notification will be sent later today, confirming the exact time and date. We expect the maintenance to take 1 hour with Podio offline.

We currently do not see issues with new items created being unavailable however there is a risk of this returning as load increases on the platform later today. Therefore be aware that we have a risk of this issue occurring again today:

We have a risk of seeing issues with newly created items on Podio - this is causing errors when trying to access newly created items.

We are currently conducting database maintenance of Podio in the backend whenever load on the platform is low while Podio is still online and available, this will increase pressure on the database over the next week.

The background maintenance is a preparation towards a larger maintenance we are planning later in the weekend on April 13-14. The background maintenance can in some occasions mean that newly created items will cause error when being accessed within the first few minutes, however the items will remain on the platform and there is no risk of dataloss

Team is working to reduce impact of this as much as possible, in order to make newly created items available faster.

We will continue to keep you updated here.
Apr 5, 07:17 EDT

Update - We currently do not see issues with new items created being unavailable however there is a risk of this returning as load increases on the platform later today. Therefore be aware that we have a risk of this issue occurring again today:

We have a risk of seeing issues with newly created items on Podio - this is causing errors when trying to access newly created items.

We are currently conducting database maintenance of Podio in the backend whenever load on the platform is low while Podio is still online and available, this will increase pressure on the database over the next 1-2 weeks. The background maintenance is a preparation towards a larger maintenance we are planning later in April. The background maintenance can in some occasions mean that newly created items will cause error when being accessed within the first few minutes, however the items will remain on the platform and there is no risk of dataloss

Team is working to reduce impact of this as much as possible, in order to make newly created items available faster.

We will continue to keep you updated here. We hope to share an update by tomorrow April 4th to when we are able to conduct the planned maintenance event that we believe will improve performance longterm.
Apr 3, 22:52 EDT

Update - We are continuing to work on a fix for this issue.
Apr 3, 10:38 EDT

Update - We have seen improved Search performance after the fixes yesterday. Unfortunately we still see issues with new item creation on Podio - this is causing errors when trying to access newly created items.

We are currently conducting database maintenance of Podio in the backend whenever load on the platform is low while Podio is still online and available, this will increase pressure on the database over the next 1-2 weeks. The background maintenance is a preparation towards a larger maintenance we are planning later in April. The background maintenance can in some occasions mean that newly created items will cause error when being accessed within the first few minutes, however the items will remain on the platform and there is no risk of dataloss

Team is working to reduce impact of this as much as possible, in order to make newly created items available faster.

We will continue to keep you updated here.
Apr 3, 08:56 EDT

Update - Update - New search capacity has been added today and slowly been rolled out to the full user.base. We estimate improved Search performance for the rest of today and going forward.

Please let us know in Support if you still experience increased errors with search after today 11.30 EST (17.30 CET).

We are currently conducting database maintenance of Podio in the backend whenever load on the platform is low while Podio is still online and available, this will increase pressure on the database over the next 1-2 weeks. The background maintenance is a preparation towards a larger maintenance we are planning later in April. The background maintenance can in some occasions mean that newly created items will cause error when being accessed within the first few minutes, however the items will remain on the platform and there is no risk of dataloss.

We will update with a scheduled larger maintenance during a weekend when this time has been confirmed, ETA is currently mid April.

Thank you for your patience.
Apr 2, 11:32 EDT

Update - New search capacity is still in the progress of being added. We estimate improved Search performance by tomorrow but will keep updating here when we expect better Search performance.

We are currently conducting database maintenance of Podio in the backend whenever load on the platform is low while Podio is still online and available, this will increase pressure on the database over the next 1-2 weeks. The background maintenance is a preparation towards a larger maintenance we are planning later in April. The background maintenance can in some occasions mean that newly created items will cause error when being accessed within the first few minutes, however the items will remain on the platform and there is no risk of dataloss.

We will update with a scheduled larger maintenance during a weekend when this time has been confirmed, ETA is currently mid April.

Furthermore, we are currently working to increase the Search capacity with the purpose to reduce search errors that are elevated from 10 - 12 am EST. We will update here when Search capacity has been added. Estimate here is April 2-3.

Thank you for your patience.
Apr 2, 07:34 EDT

Update - We are continuing to work on a fix for this issue.
Apr 1, 16:53 EDT

Update - We are currently conducting database maintenance of Podio in the backend whenever load on the platform is low while Podio is still online and available, this will increase pressure on the database over the next 1-2 weeks. The background maintenance is a preparation towards a larger maintenance we are planning later in April. The background maintenance can in some occasions mean that newly created items will cause error when being accessed within the first few minutes, however the items will remain on the platform and there is no risk of dataloss.

We will update with a scheduled larger maintenance during a weekend when this time has been confirmed, ETA is currently mid April.

Furthermore, we are currently working to increase the Search capacity with the purpose to reduce search errors that are elevated from 10 - 12 am EST. We will update here when Search capacity has been added. Estimate here is April 2-3.

Thank you for your patience.
Apr 1, 07:49 EDT

Update - The response times have improved. Team continues to monitor and work on resolving the issue. Thanks for your patience.
Apr 1, 04:31 EDT

Update - We are seeing increased latency right now. Team is investigating to fix the issue.
Apr 1, 03:45 EDT

Update - We are aware of the current increase in Search errors from 10 am to 12 am EST, we are working to scale up our search infrastructure to resolve this. ETA should be sometime next week for improved search performance. Thanks for your patience.
Mar 27, 10:57 EDT

Update - Podio is again operational and we are truly sorry for the continued errors over the last few weeks. We are working on a longterm plan to address these issues.

We are also aware of increased Search errors on the platform from 10 am to 12 am EST, we are on the side working to scale up our search infrastructure to resolve this. ETA should be sometime next week for improved search performance.
Mar 27, 05:54 EDT

Update - We believe to have found the bottleneck and load is coming down. You should see better responses now.
Mar 27, 05:16 EDT

Update - We are looking latency on Podio - team is investigating
Mar 27, 04:51 EDT

Update - We no longer see errors on accessing new items being created however we are monitoring closely for a full resolution. We have also taken extra steps to ensure better performance tomorrow. We will keep this incident open and will keep you updated tomorrow.
Mar 26, 15:12 EDT

Update - We had 5 minutes of increased latency of the app however performance have been stable since. We do have two on-going issues still happening: We currently see increased level of errors for Search, team is looking into this. We are also aware that newly created items can show errors when accessed, this is due a delay in our database. We are working towards longterm solutions for all of them.
Mar 26, 10:59 EDT