I agree.
The ONLY two reasons opponents abort games on me:

I've had games aborted from players that are within a few rating points of me after I've played 1. e4 many times. I don't think this is accurate.
On the flip side, I have aborted a fair few games because I've accidentally chosen the wrong time control or because I've hastily pressed "new game" (particularly while tilted from a loss) without checking if I have time for another game first.
If you need help, please contact our Help and Support team.
#1. They didn't bother setting their minimum rating threshold, and abort when they see I'm 100+ rating points below them.
#2. I play 1.b3, and they abort after seeing it.
That's it. No other reason.
IMO aborting at all should not be allowed. Resign or play it out.