WHAT!!! Don't tell me you missed that part of the movie, you must have blinked at that moment.
It was going on in the back ground when you weren't looking :))
And BTW, I Don't remember in the movie, street scene battle, having all the Avenges facing Loki all together either ;)
Come on mate...