I'm going to take this back off track for a minute.
I made my first black powder cannon when I was 14, in high school. It had a 9/16" bore and was almost a foot long. I had a lot of fun with it. I packed it with paper towels for years. A good thing too because one 4th of July I accidentally shot my mom in the back from 30 feet away. The paper towel wad left a nasty bruise.
Now I have a 6 shot, 3/4" bore signal cannon and a 1-1/2" brass signal cannon (I've shown it on this website). I'm not bragging. I'm letting you know I have 40 years of experience with black powder cannons.
Many years ago, my best friend, who also had a black powder cannon, and I decided to find out what kinds of crap we could fire. And of course we experimented with pipe cannons and the like. We even, once, buried 3 stick of dynamite 3 feet deep to make a crater. It didn't go off and we're pretty sure we retrieved all the dynamite but it was sort of, well, spread out from the blasting cap.
Again, this isn't to impress.
A former coworker and I were bored when it was slow at work and we played around with the chemicals in the shop to see which one would make the best propellant. Starting fluid did pretty good.
Now, this is why I am writing.
My best friends cousin ended up losing all the hair on one side of his face and head while breech loading a cannon without waiting for any remaining embers to extinguish.
My best friend made a 2" pipe cannon and we buried it in the ground with the barrel opening just above ground. I didn't see that he lit it and ran right past it, luckily right before it went off. The pipe didn't contain the explosion and turned into a tulip. We never found the top half of the pipe. It was packed with jelly beans.
A different friend and I were firing grade school glitter from my first cannon. We were firing it into the sky. It was really pretty coming down in the streetlights. It wasn't pretty having my friend remove pieces of glitter from my eyes.
As I said, I have experience.
My coworker and I managed to find the best propellant. We were using a 3" tube with a golf ball and a carrier. We shot one so high we couldn't see it anymore and scurried under cover in case it came down near us. It wasn't far off. Maybe 30 feet. It bounced almost high enough to not see. Ended up hitting the hood of a car.
OK, so what's the point here?
You mentioned the golf ball was a snug fit. This could be a bad thing. Gold balls deform pretty easy, relatively speaking. When the pressure is applied to the bottom of the ball, the ball will spread and, possibly, create a tight plug. This could be a bigger bang or it could be an explosion.
Chances are you will be fine. Chances are, that is.
If I were going to fire a projectile from a cannon, I wouldn't use anything that could compress and plug the bore. And if I did do that, I'd take cover before it went off, just in case.
Also, FWIW, if you want a good bang, cheap bread works better than paper wadding.