I can feel this too, man !
Also, I used to ask one Chess.com moderator and he simply explained that this might happen due to our disconnects or lags in our computer, which does not satisfy me much :v
Here is my issue:
https://www.chess.com/forum/view/general/premove-and-timeout-question
one game whenever i moved a piece or made an arrow the game would freeze for 5 seconds 
When i play 5|5, i mean 5|5. I dont want 5 minutes with a 5|5 opponent.
Yeah, sometimes, this platforms' service goes wrong for no reason and I can def relate to this.
It is kinda annoying, treats us unfairly and even drives me mad in some matches. But sadly, we can't demand more, since I assume that they, the Chess.com technical staff, probably have troubles in fixing these bugs in large-scale users or can't come up with new solutions for our problems at the moment. That's the deal ! 
If you need help, please contact our Help and Support team.
I really like how sometimes the servers can't receive my move in time. It really brings out the duality of man. Yes, I do have checkmate in one on the board, but how cool would it be if you actually lost this game!