Yea, I have done that. I would heat the disk in the oven to 150 degrees F /freeze the shaft and put together. .003" will work. Drill one or two 1/8 holes after they are together at the joint and place a dowel pin in it for a permanent joint.Here's the plan....
I have 3/4" aluminum plate and plenty of round bar, also aluminum. I want to make a new crank and handle for my mini lathe carriage but, I need a bushing to be drilled, bored and reamed to fit the shaft with a set screw. I thought I could press a piece of round bar into a disk cut from the plate and then drill and ream that for the shaft. Add a knob with bearings on the front and I'm done.