Mic6 alu plate will get you a long way to the tolerances you're after and I think it might be a little harder (not to machine though) than regular 6061. Not 100% sure on that last part, but I know that mic 6 is used for fixture and tooling plates where higher tolerances are required, but not so...
www.hobby-machinist.com