timeclock issues

I was playing a game, and after I moved my opponent's clock started.  He appeared not to move for many minutes, so I went to his homepage to see what he was all about.  I came back to the game to find out that not only had he moved, but my clock was down the many minutes I thought HE had wasted.  Anybody else experience a similar issue, or is this my computer?