Does it need to be an accurate size? If no belt sander.
Or if there's a through hole, there's the method of sticking a pin through the bore, rest the ends of the pin on the top of the vise jaws, clamp the part, mill, then rotate & repeat. If you rotate it enough & in small increments you'll minimize the faceting & can clean up the rest with a file.
Or a corner rounding endmill if it's small enough. Some people use radius router bits too.