It's tape flanging, not a plugin.

They ran the drum track through two tape machines slightly out of sync, then mixed them together. That’s it.

The effect comes from the time delay between the two reels—one was slowed down by hand on the flange (the edge of the tape reel) while the other played normally. That wobbling, sweoshing sound is the phase cancellation.

No digital trickery. Just a guy with his finger on a tape reel. It’s the same trick they used all over the record, just particularly clean here because the drums are sparse and the room is dry.

Next time you hear that swoosh, imagine a bloke in headphones, touching the tape with a pencil.