Programming.Dev is going to be going down starting at around 00:01 UTC Monday Dec 2 to attempt to fix the database corruption that happened relating to communities.

This has been affecting attempting to look at the pages for certain communities (it would end up loading forever instead of actually showing the posts for the community) and was affecting federation in some cases.

This is the second attempt to fix the issues with the first one needing to be rollbacked from due to the fix not working.

This fix could take several hours, so the outage window is going to be from 00:01 - 06:00 Dec 2.

  • snoweMA
    link
    fedilink
    arrow-up
    7
    ·
    3 days ago

    The fixes are done for tonight, but are not 100% complete. I estimate that 99.4% of cases have been fixed though. You might see problems with individual posts, but every community should be fixed. I’ve seen at least 1 issue with the [email protected] community and I’ll be investigating that if it doesn’t self resolve (stuff could still be catching up).

    IF YOU SEE ANY MORE ISSUES PLEASE REPORT THEM HERE.

    • my_hat_stinks
      link
      fedilink
      arrow-up
      1
      ·
      edit-2
      2 days ago

      Edit: Definitely not relevant, it was a problem with the link I clicked

      original

      Not sure if it’s related but I’ve noticed a couple of smaller communities from other instances which aren’t accessible from programming.dev any more, Imaginary Witches and Imaginary Fairies. They give the very helpful error “unknown”, this might be a fun one to try to track down. They’re accessible on the source sites (1, 2) and other communities from those instances seem to work.

      Screenshot displaying error page with text "The server returned this error: unknown."

      • Scoopta
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        2 days ago

        Wait [email protected] is broken for you? For me in Jeroba that’s one of the communities that’s been working just fine this whole time, unless the recent maintenance broke it the last post I have is from yesterday.

        EDIT: Ok, so clicking your link, or even my link gives an error saying community can’t be found but I can still pull it up from my subscriptions, so it was either broken by this maintenance or something weird is going on

        • Draconic NEO
          link
          fedilink
          arrow-up
          2
          ·
          2 days ago

          I can access many of the broken communities from external links and I might even be able to create posts in them from the UI but I cannot access their links directly from the UI, and they also don’t load from my mobile App.

        • Blaze (he/him)@feddit.org
          link
          fedilink
          English
          arrow-up
          2
          ·
          2 days ago

          For me in Jeroba that’s one of the communities that’s been working just fine this whole time, unless the recent maintenance broke it the last post I have is from yesterday.

          That’s strange indeed, the community has been inacessible from the web UI for weeks