I clutchless shift all the way up through the gears if I'm ripping on it. Cant say theres any difference per gear so your deal is strange for sure.
Seems really strange for the clutch cable adjuster to rattle loose too.
I did have the clutch adjustment jam nut (in the primary) come off on my Harley which caused similar symptoms. Might pull the derby cover off and check the full clutch adjustment?