I use them all, but like many have said, keeping track of the torx screw sizes is a bit of a PIA; I find myself having to carry 3 different tips when using different length screws some days.
As to Phillips drive, I use P2R bits, they last longer and dont cam out much due to being relieved (the 'R')