There is always the chance that someone else used the wrong bearings before you. Did you just replace like for like, or did you get the bearing info from a parts sheet? It probably wouldn’t explain the misaligned rabbeting ledge but it may well be the cause of the axial play in the cutterhead.