Thanks for the input so far, guys. I am interested to see if this inspires you to check your own machines, maybe it's just mine, but maybe it's an unnoticed problem. I did leave out lots of details initially, because I'm questioning all mag scales. Secondary to that is troubleshooting my machine- I can't use a scale I can't trust, that's a hard line in the concrete to cross.
I squared my vise and calibrated the x and y to 1-2-3 blocks with a tenths indicator and a mag base on the head Saturday morning. I was consistently .0004 long (two steps) on y, so linear comp was applied and tested good. Removed the mag base and set up work. During work, I used a mag base for a chip shield. Part came out on size. When I was tearing down is when I saw the numbers flip like a slot machine, an obvious response to a moving magnetic field. The induction must be great enough to trip the trigger in the head, which surprises me. I don't know the effect on the display during power feed or just manual movement, it settles down when static.
This is my Lagun FTV-3 mill, it has a 55x11" table and comes in at almost 4,000 lbs. Sh*t, I put it that way and I feel like an idiot for not going glass to begin with. Oh wait, I did order glass DC10 scales, says right here on my invoice from Ditron, but they sent me 5 mic magnetic. I've never been very excited about these, maybe that's why I never quite finished the job of installing it. The head is a Ditron D80, which I've gotten to like now that I understand it's features. If I trusted it completely, I'd like it more.
I believe that whenever two scales are read, interpolation of either scale becomes possible, with step counts and auto correction becoming possible using the reference track. I don't know so much about the implementation of such techniques in these systems, just what I can read about the technology in general on the web. I am okay with the realities of precision measurement. I have read and referenced the NIST-backed Guide to Uncertainty of Measurement in many papers, so I have realistic expectations of what I can measure and make in my shop, especially without producing some scrap to get there. On the mill, I'd be kidding myself and lying to you all if I claimed to own control over my work to any less than the .001 or .002 that these scales can measure reliably, in the wild, as installed. It's not about precision, it's about a vulnerability that could impact the worth of the numbers displayed on the screen.