I shoot a Savage 110 in 300 Win Mag. When I purchased the rifle I opted not to get the muzzle brake option as it seemed counter productive to my needs. A muzzle brake increases blast decibles, especially from the sides, and creates an unnecessary cloud of dust at the muzzle. The volictiy of the bullet is decreased when the brake is open, porting off gasses. On a larger caliber such as a .338 or .50, I would support the brake for, if nothing else, survival of your limbs. I'm no sniper, just a avid hunter and target shooter. The .300 Win Mag is a kicker and the brake doesn't change that very much. Any time you vary the physics of the barrel you stand a chance of deminishing the accuracy. Barrels should free float in the stock supported only at the action, with nothing else touching. Hanging a flashlight or optics forward of the stock secured to the barrel will lessen accuracy. A lighter caliber such as a .22 may not be as effected because of the lighter harmonics in the barrel, but be careful with 99% of other guns. Rails or stock modifications are cool if you do not alter the mounting of the action other than glass bedding, etc.
You did a very nice job on the rifle and the brake. No reason a guy can't have fun anyway.