I was in the same boat yesterday trying to make a hex tap holder for a Jacobs chuck in the tailstock.
Everything went well till I stuck it in the hex collet holder with a 5/8 collet in the mill vice.
Laid out the 6 hole pattern to drill the holes used the boring bar to remove a lot of the mat'l down to 0.35, the thickness of the die.
Started drilling the holes and lo a behold I had not tightened the collet nut enough and the part turned a bit in the holder!!
Bummer!
back to the drawing board.
I have just enough stock left for 2 more attempts at this point.
Perhaps we should start a new topic thread entitled "What SNAFU followed you to the shop today"!!