You can get 1.25" endmills (roughing would be OK), even indexable carbide ones. And an R8 shank 1.25" holder
shows up on eBay for not much money. It's likely that a three-jaw chuck and floppy arbor (like for a hand drill
operation) won't be as effective as just... a big hunk of cutter.
The tubes will come out better-looking if you put some aluminum soft jaws on the vise, and cut them into
C-blocks, then just mill your cuts through them (holding the tube with lower pressure over
a large area). rather than extending out from the vise.