There's a method for measuring dovetails with dowel pins you could use to hit that dovetail dead on. Don't go full width, go about 3/4 then measure, then you know how much wider you need to go. You can then sneak up on it, to the point that you're a few thousandths under, then take tiny cuts till it fits well (or you hit your measurement if you trust it) Then the cutter diameter and spindle runout and other factors don't matter. Unfortunately I'm on a phone, so its hard to type math. Should be easy enough to search though.