They could allocate sell a percentage of cheap stand-by tickets. Tickets that were cheap and sold on the basis that you might get bumped.

Of course not letting the passengers you want to bump onto the airplane first would be way better than letting them get seated and then forcibly removing them. That's just lazy and chaotic planning.