I caught that too...but I think that was part of the character. Constantly driven and maneuvering. A little frazzled...a contrast to the sharply pressed and perfectly appointed Tarkin who is quite literally nipping at Krennic's heels.
Considering the character, a neatly pressed and perfect cape would almost look wrong....
I liked this about him, unlike most Imperial commanders, this guy was out in the trenches making sure things got done.