My belt will do the same thing after a tire change or what not. Whenever I remove the belt from the rear pulley the belt will creak and click ever so slightly when pushing the bike forward or backward in the garage. After the first ride it seems to settle back into place and not make a sound.
As far as the sound from the idler pulley; check the bearing. If it spins freely and has no excessive movement, just give it a little oil and see if that makes the sound disappear. If the idler pulley bearing has excessive free play or has difficulty spinning freely, replace the bearing.
I've seen a few posts on here that included a part number for the bearing and a how to. You'll have to google it to find it on the site. If you haven't figured it out yet, the search function doesn't work so great.
Good luck