Rogan was never going to allow Harris on his podcast