What you like to play against d4 or e5 depends very much on your style. Against d4 why not play the Queens gambit yourself?
What I would recommend to play is Nimzo-Indian and the Queens-Indian defense. They are really rocksolid. You can also experiment with other Indian defenses like the King's Indian or perhaps give the Grünfeld a try? Not to forget the Dutch defense and the Benoni...
Against e4 I always like to play 1...e5. If you like the Sicilian defense then play this opening. It's a good idea to try out different openings. The French defense for example, teaches you a lot about pawn structures. When you've tried different openings it's easier to choose which one suits you best.
Good luck!
I want to start playing the queens gambit as white, however unsure what to play as black. For players who play the queens gambit as white, what do they generally prefer to play as black? So what against 1 d4 and what against 1 e4?