IMO You're right. For example when I'm playing against a 2500 computer and it humiliates me horribly I'm pisted off I'm not in the gg mode.
If someone tells you gg it means 99% that you weren't that menacing :maybe you defended well against his attacks and he condescendingly acknowledged it
It's neutral. If I lose and someone types gg, I'll type gg back.