Turns out that tags are remote-agnostic in git. Beware fetching them from multiple remote, it can get messy.