Yeah, I'd rather not buy a hand punch since I only need it for 4 holes and they are expensive.
I don't have a rotary table and my Kurt vise is not rotatable. Maybe, I'll mill a circle of the smaller diameter (between the flats) and file to shape. Or, I can just forget the flats and just make it round!