FYI - Amazon has a pretty good deal on YG-1 parabolic stub length drills. I'm a big fan of parabolic flutes in aluminum as I can plow down with no pecks fairly deep. The flutes clear chips like mad, and you can up the feed rate. I'm running flood, but a squirt of kerosene or WD40 also works.
A quality, straight stub length drill means no spot-drill needed. One less operation & tool change.
If you find yourself drilling lots of 1/4-20 holes, especially in aluminum, you might consider switching to form taps. No chips, no backing it out every turn or two. Nicer threads. Just buy a 15/64 or "C" drill and have at it.
I've also switched from buying/using drill indexes to individual drills. There are about 5-10 drill sizes I use constantly and I've found that buying a few nice drills in just those sizes means they cut better and I'm not up the creek if I wreck one. I sitll have an index for those odd-ball sizes, but mostly use the 'good'' drills in the most-frequently needed sizes.
Just a suggestion, but if you buy 5-packs of individual drills they can get pretty inexpensive. As I mentioned, I'm big fan of the YG-1 stuff. They aren't top of the line, but they're way, way cheaper than OSG, Guhring, or Nachi and they are light-years ahead of 'cheap' drills. Widia is another lower-cost but quite good quality brand.