I think the larger radius inserts will have a better finish, but increased deflection due to higher cutting forces. Do try it out and report back. It's an interesting experiment. There might be a sweet spot.
What's the sample material, 6061? Nice project, I need to make something like this. When you get a chance, can you take pictures of the complete tool out of the mill? I'm missing some details in my mind and a couple of pictures could make them clearer.