Just discovered nosetests has a --failed flag that lets you re-run only the failed tests. Brilliant, wish I knew about it earlier.