If you cut from inside to outside using a CCMT type insert, the cutting edge when cutting from inside to outside is much longer resulting in higher cutting forces.
Chatter means the cutting forces are to high for the setup. Either make a more rigid setup (less stock stick out, less tool stick out, less top slide over hang, etc) or reduce cutting forces by reducing depth of cut, reducing feed per revolution, reducing RPM, reducing tool nose radius, use a sharper tool, etc.
If the tool is not on center but to low, facing that last 0.5 mm pip will chip the tool regardless of the setup or turning parameters.