Turns out that you can convert eggs to wheels. Eggs are nice as they save you recompiling, but using wheels gives you pip! Hurrah!