When you remove friends it doesn't automatically turn off tracking (which is automatically turned on when you add them). Try this:
My Home -> Account -> Alert & E-mail Settings
At the bottom of that page you'll find a list of "Currently tracked members". You have to remove them from that list as well.
How come when I remove friends they don't leave the list?