McMaster Carr does indeed have them for unthreaded holes.Probably McMaster Carr. You might try collapsing the existing one with a chisel used axially, a few blows with a good sized hammer will do the job.
McMaster-Carr
McMaster-Carr is the complete source for your plant with over 595,000 products. 98% of products ordered ship from stock and deliver same or next day.
www.mcmaster.com