I don't see how you don't avoid the Grunfeld. Kramnik was a 1.Nf3 player and he often avoided it!
1.Nf3 Nf6 2.c4 d5 3.cxd5 Nxd5 4.e4 avoids it!
1.Nf3 d5 2.d4 Nf6 3.e3 avoids it. 3...e6 is a Colle, 3...Bf5 or 3...Bg4 allows 4.c4 leading to a Slow Slav or anti-Colle setup
1.Nf3 Nf6 2.c4 g6 3.Nc3 Bg7 4.e4 avoids it (4.d4 would be the main line of the KID and would allow 4...d5) After 4.e4, Black can still play a KID if he chooses, but not a Grunfeld!
It's a lot harder to avoid the King's Indian without simply playing passively and giving up all advantage. For example, 1.c4 c5 2.Nf3 Nf6 3.Nc3 Nc6 4.g3 g6 5.Bg2 Bg7 6.O-O O-O, and now 7.d3 gives White nothing and Black has easy equality while 7.d4 transposes directly to the Fianchetto King's Indian!
The Nimzo-Indian and Grunfeld can be avoided more easily than the King's Indian.
Alternatively, I don't have a good black opening against 1.d4, so I wonder if I might as well just start playing the Grunfeld if being more theoretical is the best approach (as black I play the Sicilian Kan against 1.e4 and obviously 1... c5 against c4/nf3). Thanks in advance.