After years of just using any old scrap, I made myself a fancy holder for pieces of bamboo.
It hangs on the tool board, ready for easy use:
Bamboo is works really well to push out those little chips.
Every so often I have to pick 'em out with the backside point of a regular X-Acto #11 blade.