.
have a look at the below schematic diagram (check it's your model too) and make sure your spacers are on the correct sides and that your brake calliper is seated correctly on the rail that is situated on the inside of the swinging arm. Also make sure you wheel is absolutely vertical when you present it back to the rear arm. Any deviation from 'perpendicular' will create an issue as you describe.
You mustn't attempt to bend out your swinging arm. It'll fracture and there is no need. There will be a simple solution buddy. We've all had hassles with rear wheel fits. Another hint is to use a chock of wood under the rear wheel so the weight is taken for you and things may well line-up so it's easier to push the spindle back through
Good luck..
https://www.ajsutton.co.uk/genuinepa...ar-wheel?uID=0