I did it! It is simply glued on. All you do is tug on it back and forth a bit and it just gives! Popped right out.
Just be careful not to use tools as it may scratch the paint. I merely used my hand and yanked.
For all those who complained... YES it did royally suck with this problem...