Google Cloud accidentally deletes UniSuper’s online account due to ‘unprecedented misconfiguration’
www.theguardian.com
Super fund boss and Google Cloud global CEO issue joint statement apologising for ‘extremely frustrating and disappointing’ outage

A week of downtime and all the servers were recovered only because the customer had a proper disaster recovery protocol and held backups somewhere else, otherwise Google deleted the backups too

Google cloud ceo says “it won’t happen anymore”, it’s insane that there’s the possibility of “instant delete everything”

  • Optional@lemmy.world
    21·
    6 months ago

    While UniSuper normally has duplication in place in two geographies, to ensure that if one service goes down or is lost then it can be easily restored, because the fund’s cloud subscription was deleted, it caused the deletion across both geographies.

    TFW your BCDR gets disastered.

    Also “massive misconfiguration” is the “spontaneous disassembly” of cloud computing. i’m sure it’s mutiple systems are misconfigured causing chaos but it sounds hilarious.

    • catloafEnglish
      1·
      6 months ago

      Geo redundancy isn’t BCDR. They did have a backup in another cloud provider, which is smart for this exact reason. If Google deletes all your shit, and you don’t have a backup outside Google, you are well and truly fucked.