Are you playing it via 1.e4 or 1.Nf3?
Speaking as one that plays 1.e4, and only plays the KIA against e6 Sicilians (1.e4 c5 2.Nf3 e6 3.d3), I can tell you that in general, the King's Indian Attack is best played when Black has committed to ...e6, meaning either the line I gave already, or against the French.
That said, it's also "playable" against the Caro-Kann, though possibly not as strong as against the French or 2...e6-Sicilians. Same can be said about the Alekhine, Pirc, ...d6 and ...Nc6 Sicilians, etc.
It is completely unplayable against the Scandinavian Defense. 1.e4 d5 2.d3? dxe4 3.dxe4 Qxd1+ 4.Kxd1 is just good for Black as he has not committed his c-pawn to c5 yet, unlike 1.d4 d6 2.c4 e5! 3.dxe5?! (3.Nf3 is best) dxe5 4.Qxd8+ Kxd8 and the White c-pawn is a problem in that it gets in White's way from being able to execute the best plan against this idea.
It is also completely ineffective against 1...e5. Black has zero problems after 1.e4 e5 2.d3 or 1.e4 e5 2.Nf3 Nc6 3.d3.
I intend to try the King's Indian Attack in the following weeks. Only, however, (and just like with any system opening) there are some situations when it simply doesn't make sense to play it (like Colle against the Indian formation). In which situations I should resign from trying the KIA and what should I do instead?