Spoiler:Russo brothers have noted that old man cap actually traveled into this dimension. Basically he traveled to the bench right when they thought he would return, he just waited until Peggy died and enjoyed several decades of life.
Oh wow... Are we officially clear to spoil now?