I would have took the queen on the 7th move. Black didn' pay attention to his king safety and you took advantage by controling the d and e files. He made some rook move mistakes. It was genious more than luck. Well done!
After 5.d4, best for Black is 5...exd4. 6...Bxe5?? loses the Bishop. Perhaps 6...Bb4+ and if 7.c3 then 7...Qxd1+, then 8...Bc5. If 7.Bd2, then 7...Bc5.
Is this a lucky win for me or pure genius :)