The only new posts that are coming up are from lemmit.online, or posts from a couple Mastodon users. This is the last exception I could find. Checking lemmy.world shows there should be new posts coming in, but they’re not showing up.
Morning all! It does appear like we’re not getting some instances posts (you can find a list by using https://phiresky.github.io/lemmy-federation-state/site?domain=pawb.social). I’m currently investigating and I appreciate folks poking on this :3
Restarting the federation pods appears to have at least lowered the failure queue a little, but it’s showing that while we’ve sent things to lemmit.online (as the example), it hasn’t seen anything from them since 4/14/2025, 10:14:27 PM. So I’m presuming the next time they try to sync and send something to us it SHOULD update…
The federation state checker seems to be indicating that we’re not behind in sending them posts anymore so outgoing should be fixed, but I’m unsure how to troubleshoot incoming further. I’m wondering if there’s a bug with the latest version of Lemmy?
Update: Turns out a security feature we enabled to block “AI Bots” (like ChatGPT) was blocking federation traffic… Since it’s affecting stuff right now, I’ve disabled it again until I can get time after LVFC to take a look into building a comprehensive “allow list” of different federation traffic headers.
tl;dr Give it a little bit and things should hopefully catch up with new posts, but I don’t know if Lemmy post-syncs old posts without someone searching for them on our instance.
Thanks for fixing it!
I’ll comment outbound seems off too. I checked from lemmy.world and new stuff from here is missing.
We’ve been banished to the shadow realm :(
We’ll be alright!
