I think you missed 3... exd4 e.p. which actually makes it 3.d5??
True, Black misdefended. He should have captured e.p. But don't your opponents usually misdefend? You should be prepared to take advantage of Black's mistakes. (So 3.d5 is perhaps an !?.)
If you can play 3. e5, then I can start a game with 1) Bc4 (the X-Ray attack)
Well, if you're going for an X-Ray Attack, just play 1. Bb5+. Since the king can only move one square, and they're all taken, you can just capture with 2. Bxe8 next move and win.
True, Black misdefended. He should have captured e.p. But don't your opponents usually misdefend? You should be prepared to take advantage of Black's mistakes. (So 3.d5 is perhaps an !?.)