While setting things up found a minor error in my drawing. The right side slots were inadvertently offset a mm. Fixed that, and altered the slot width. Had set it up as 6.2mm wide. I don't have a 3/16 end mill with that LOC. So changed it to 1/4". Bumped the revision of the drawing to "A".
Won't be a pretty slot since I can't clean it up, but it allows me to use the tooling that I have. I will still use an M6 to fasten to the lathe. Want to keep everything on the lathe the same kind of hardware, i.e. metric.
Edit:
Ran into another gotcha. Ran out of travel in the Y axis. My vise hits the bellows bracket. I only need 5mm more travel to do this job. I have run into this before. A possible solution is to get a thinner bellows or make a window shade roll up. (The bellows is 40mm deep, I think one can get a 15mm version.) Think I will try to get the window shade thing to work. I had run into a problem with it a while back and put it down. Of course I forgot about it. And now it has bit me, again. The issue with the roller was the roller spring was expanding and hitting the ID of the PVC pipe I used. This causes enough friction that the device won't retract. Rollers use a torsion spring. Maybe I can bore out that section where the spring is. Think I can relieve the inside bore by 2mm in diameter which might free up the spring. Kind of hard to do this as the reach is 4", but it is PVC.
In the meantime, I redid the drawing yet again. Put the datum in the back left corner. If I do that, I can reach all the machinable sections without hitting the column. Which is enough to get this job done. I will have to remember this for future drawings.
Kind of weird to hit the stops with a piece that is only 4"x5", but that's how it works on these little mills with a vise. Could bolt it to the table, that would work as well. Or turn the vise around... Not sure why I didn't think of any of these things while I was in the shop.