What I do is change the publication date (I have the category list ordered by last published). Changing the date to previous time thus orders results.
But it is true that it would be interesting to have an automatic option that takes temporarily out-of-stock products to the final part.