I prefer e4. it is easier than d4 to do castling. I usually play like this; 1. e4 e5 2. c4 Nf6 3. d3 like this. it is defensive... or 1. e4 e5 2. f4 for remove opponent's E-line pawn and it is quite good.
I play neither but if I did I would prefer d4 because there are less replies against it than against e4, who wants to learn ten separate openings and all their lines when playing one opening.