I risked this too often, usually because trying to get variable width material in a stationary vise rarely results in the drill being in the required location.
One solution
I welded a rod to a plate, and then made a small mounting block that hangs off the edge of the table. It’s a pleasure to use, takes a few seconds to line up the center regardless of the width of the material.
I also mounted a linear actuator under the table, so simply manipulating a small toggle switch moves the table up and down.