the rating system is very complicated. The simplest explanation I can give is that the fewer games you play, the less accurate your rating is. If your rating is less accurate, it can go up and down by more points when you win or lose, but since your rating is not accurate, your opponent only gains or loses a couple points. The more games you play, the more accurate your rating is and the more points the other person will gain or lose when they play you
Question about how inconsistent chess ratings are...

How many points you win or lose depends on the rating difference and your clicko at the time.
http://math.bu.edu/people/mg/glicko/glicko.doc/glicko.html
Whenever I win a game against a much higher rated player, he only loses about 2-3 points. I only gain like 20. Shouldn't he be losing a lot more points? How is this fair?