I don't have a complete repertoire against 1.d4.In blitz I usually play Englund Gambit and sometimes Dutch Defense and in rapid I don't know what to play.
It's normal for 1 e4 players to be a little uncomfortable after 1 d4. I recommend against trappy stuff, it stops working at slower time controls. You will just have to pick something solid and learn it. Often Caro-Kann players favor the Nimzo-Indian and Bogo-Indian, worth considering.