The most likely explanation is that your disconnection is due to either your client or something on your system, your ISP, any of the number of hops between your ISP and chess.com, to the Live server.
Players don't directly connect, to my knowledge, and your opponent has no way to know your connection details to force a disconnection on your end.
Take a read of the following that might help with disconnect problems:
I can't count the hundreds of times I have been removed from a game by the opponents here. BOOTing - the act of being ejected from a game by an opponent; one who has the ability to cue in to another's computer and remove them from play.
How can this stop?