No you don't need to pull the rotor(s) or drive belt pulley.
No they don't need the axles.
What torx bolts did you have to remove to remover the wheels?
I didn't remove the idler when I did my belt. It's a bit of a PITA, but probably no worse than removing the idler.