Due to play in the rubbers your chain can move sideways which speeds up chain wear. Indeed replace your chain (I do not change the sprockets because the last longer then the chain) and the problem will be solved.