If your grinder vibrates excessively there are two potential causes: the wheel isn't true, or the bearings are shot. The former is easily dealt with. If you're going to use a grinder you need some sort of dressing tool. I like the "star wheel" style, but there are also abrasive sticks and diamond dressers. I have all three, but find the star wheel style the easiest to use. Grabbed this link for illustration, I don't know this company at all.
https://www.victornet.com/tools/Grinding-Wheel-Dressing-Tools/85.html
If you true your wheel and the grinder still vibrates excessively you probably need a new grinder (unless it's a Baldor, or something equally worth repairing, in which case you need new bearings).
HTH,
GsT