the idler pulley assembly will do this if not installed correctly.
If it shifted over before you disassembled the rear, I would be tempted to pull the wheel and check the bearings and spacers for damage.The axle slider did its job and kept the swing arm from getting scratched but i noticed that my belt was riding farther off the rear pulley too.