Yes try what rabler suggests. The rotating piece should not rock. A cone spring (Belleville washer) will help, as would a plastic washer between that and the rotating piece. It may be an easy way to what you really care about. Some friction may be good for these, to dump vibrational energy.
What materials are you rotating piece and the stationary mating piece?
What materials are you rotating piece and the stationary mating piece?