Incidents reported on status page for blahaj.social https://status.blahaj.social/ en https://status.blahaj.social/incident/473958 Sat, 07 Dec 2024 21:56:00 -0000 https://status.blahaj.social/incident/473958#8a5d0f6e35ed2538592f523c08d0c31765cd83f1d19544a8a6f800342863d0a6 blahaj.social is back after a very intense half day in PostgeSQL... Long story short there were 3 accounts in the database that somehow causes out of memory issues to be thrown when fetched, this happened for a very long time in for example backups... It took manually extracting the data with the accounts filtered out, followed by re-inserting it. Then finally completing a backup. Upgrading the database, re-inserting all data and by hand fixing all foreign key issues resulted by those accounts painful as it was i can sleep now i know there is no longer a time bomb in the database i could only fix with full harddisk rollbacks... Sorry for all downtime caused and bash script crimes commited https://status.blahaj.social/incident/473958 Sat, 07 Dec 2024 15:27:00 -0000 https://status.blahaj.social/incident/473958#051a125de7ae3e6535fd7c55348daf6ac12962a554f178bdd0a0fe12791f315a This is taking longer than expected due to a failure of the default tooling, we wrote a data export system specifically made to rule out the broken rows in the table. This requires data export of 433 995 rows in batches of 500, this can take an hour. Thanks for your patience https://status.blahaj.social/incident/473958 Sat, 07 Dec 2024 14:15:00 -0000 https://status.blahaj.social/incident/473958#11d014719c78bc4d0d14c21937c9d70d1aa842c7987e53a2d7042fd5f3db5fe1 We are currently working on fixing a longer term database corruption of the accounts table. To run the repair we needed to take the instance online while running the scripts. We'll be back soon! https://status.blahaj.social/incident/236661 Wed, 02 Aug 2023 11:29:29 -0000 https://status.blahaj.social/incident/236661#6e67f1958ecec17f61e4c07f8128f5fb70456e27ff6133cbdc5eb5f7cae57164 Maintenance completed https://status.blahaj.social/incident/236661 Wed, 02 Aug 2023 08:00:00 -0000 https://status.blahaj.social/incident/236661#b999bf3d6d7e2457c0334df479d515105c36abd79c4c8240587a35e99294b345 Wednesday 2nd of August from 08:00 to 13:00 CET there is a planned power interruption due to works on the power grid. The outage is scheduled by the power company for up to 5 hours, however we all hope it is less. Unfortunately it will be hard to keep the server online for 5 hours on battery power so there will be downtime. https://status.blahaj.social/incident/236661 Wed, 02 Aug 2023 08:00:00 -0000 https://status.blahaj.social/incident/236661#b999bf3d6d7e2457c0334df479d515105c36abd79c4c8240587a35e99294b345 Wednesday 2nd of August from 08:00 to 13:00 CET there is a planned power interruption due to works on the power grid. The outage is scheduled by the power company for up to 5 hours, however we all hope it is less. Unfortunately it will be hard to keep the server online for 5 hours on battery power so there will be downtime. https://status.blahaj.social/incident/236661 Wed, 02 Aug 2023 08:00:00 -0000 https://status.blahaj.social/incident/236661#b999bf3d6d7e2457c0334df479d515105c36abd79c4c8240587a35e99294b345 Wednesday 2nd of August from 08:00 to 13:00 CET there is a planned power interruption due to works on the power grid. The outage is scheduled by the power company for up to 5 hours, however we all hope it is less. Unfortunately it will be hard to keep the server online for 5 hours on battery power so there will be downtime.