Folks who abort too often lose the privilege to do so. They can also end up in a special pool of "bad" players.
server aborts
They are aborting by letting the server time out so that they do not recieve your admonishment. If they are are on line they should play rather than waste other's time. If they don't play, they should be penalized a point.
I assume they are paired with a challenger because they have pressed the "Play" button. If they do, and won't play the opponent they have been paired with by letting the server time out, they should be penalized with the loss of a point.
I have not kept records but believe that they let the server time out more often when they are assigned black. You should be able to determine the statistics by analyzing the data for server time outs.
Many wait out the server because they do not want to play the color of opening move. They should be penalaized a point for waisting their oponent's time.