Thanks to everyone for the help. I cut the taper yesterday and the fit was good but I think I can make it better. After cutting the taper I had to drill and tap the end of the shaft. I was power tapping the thread with the lathe in back gear and had a little accident and spent the day in the ER. The problem was that I got distracted with someone standing over my shoulder asking a million questions, I let my guard down and got hurt. Machines deserve our full respect at all times, and that all that I have to say about that.
Not having an actual shaft to copy and put in the lathe and use a DTI to set the compound, I was able to get close and the fit was ok. But I will make another one tomorrow and use a dial indicator to set my compound angle off of a piece of ground round stock. I think I will get a much better fit.