I guess I'm confused with terminology, I was thinking the blade and the part had to be exactly parallel on the face, as in no tangents. to cut straight. That would make them perpendicular.
Just a follow up for everyone who offered me some guidance: I think I found the issue, I noticed the parting tool would almost swivel when it was mounted in the tool holder. I checked the bottom of the tool holder (where the tool mounts in the holder) against a straight edge and realized it was bowed (crowned) in the middle. I took my finest diamond sharpening stone (flattest surface I have) to the crown and it seems much flatter. I have since done 5 or 6 parting operations with almost no chatter while running in back-gear, It still wants to chatter at normal speeds, but now I am confident enough to part instead of sawing it off.
THANKS TO ALL WHO HELPED WITH THIS!
I did my 2nd part today with 4130 on the new lathe, the first one with a P2 blade was a little concave. The 2nd one I used the 1/8" Iscar at 90 RPM, on slow feed it started complaining, I hand fed it, and increased the feed, it started curling. Changed the feed rate on the Norton box and it sliced right through.