1mm of play is nothing - don't worry. As coxwain indicates 1mm at the end of the swing arm (plus the length of your spanner too!) is a massively magnified value cause by the leverage of the whole setup.

__________________