thanks everyone for the reply. I'll practice the Caro-Kann more!
Ideas for defenses against e4

Alekhine's Defense (Recommendation)
+Slow
+Positional
+Relatively straightforward
+Uncommon
-Indian Game positions, not Queen's Gambit positions.
-Somewhat unintuitive past established theory
Would Recommend
Modern Defense (Recommendation)
+Slow
+Positional
+Incredibly Straightforward
+Intuitive positions and pawns structures
+Uncommon
+Works against d4 as well
-Indian Game positions, not Queen's Gambit positions
-Simple and intuitive enough that even if your opponent doesn't know any of the theory, they should still be able to play the best moves most of the time
Would Highly Recommend
King's Indian Defense (Recommendation)
+Slow
+Positional
+Straightforward
+Uncommon
+Castle quickly
-Castle quickly
-Bishop on g7 becomes a target easily
-More Indian Game positions than Queen's Gambit positions.
Would Recommend
Caro-Kann (Because you mentioned it)
+Slow
+Supports d5
+Straightforward
-Theory dense
-INCREDIBLY TRAP HEAVY
-Weird pawn structures
-Suboptimal piece placements, LSB usually gets traded for a knight
-French but worse
Would Not Recommend
Pirc (Because you mentioned it)
+Slow
+Somewhat positional
+Uncommon
-Incredibly critical variations
-Somewhat tactical
-Theory dense
-Not Straightforward
Would Not Recommend
French (Because you mentioned it)
+Slow
+Positional
+Straightforward
+Intuitive
+Very, very solid
-Incredibly theory dense
-Incredibly common
Would Not Recommend
Petrov's (Recommendation)
+Can be positional
+Straightforward
+Light on theory
+Can be slow
+Intuitive pawn structures
+Solid
+Not common
-Not uncommon
-Can be fast-paced
-Can be tactical
Would Recommend
TL;DR
Alekhine's, Modern, and King's Indian Defenses are solid ways to play e4 like d4.
Traditional defenses against e4 are all too theory dense and opponent dependent (except the Petrov's).
My two highest recommendations would be Petrov's if you want to play a traditional e4 and Modern if you want to play a traditional d4. Alekhine's and KID are secondary suggestions if you don't like the Petrov's and Modern.

Hi! I think you should choose either the Caro Kann or the Petroff defenses that most of the time will get you to the kind of game you aim for-except perhaps for the initiative issue. But depending on White's setup, you can't avoid sharp variations anyway. Even in these openings you have players that like to mess things very early, for instance the advance 3. e5 in the Caro Kann or 4. Nf7 sacrifice in the Petroff.
Good luck!

I would suggest that you should learn Scandinavian defense, it will suit your style. For further info, you can inbox me or ask questions at thechessforum.com
The Scandinavian? Please tell me you don't play Mieses-Kotrc Main Line. The Scandinavian goes against every opening principle in the book, and there have been no major wins at the top level.
I would suggest that you should learn Scandinavian defense, it will suite your style, for further info, you can inbox me, or aks question at thechessforum.com