hi
You behaved entirely correctly.
Your opponent should not have offered a draw; that was either silly or rude. I would certainly ignore such an offer. The past history of the game does not matter. If someone makes repeated draw offers I consider blocking them. It's not worth giving the matter any more thought than this.