If you Shrink the tommy bar in place, then it won't wobble around and chew up the holes. Just make the tommy bar short enough to clear the cross slide, turn up an extension that slips over the tommy and fit the other end with a piece of wood so it doesn't scratch the cross slide. I rest the extension on the carriage. then turn the chuck - seems to leave more skin on the knuckles. Every now and again I move the extension up and down a little to clear the debris. You could use the tommy bar to turn I suppose, but I find it easier to turn the chuck.
No bearings or dissimilar material bushes, don't see the point, how fast can you turn it by hand?
I only use the die holder on 6-8mm threads and below, anything above that I prefer to cut using the lathe. Die holders are also very good for clearing damaged threads.