Ben - for the most part I agree with you. I know that some of the very high end wood workers work to vary close tolerances to facilitate the fitment of mating parts. I am not one of them. I use gauge blocks for machining steel/aluminum parts - but for me that is a whole other ball game.
David