There are a few things that you may want to improve on from this game.
1. Try to play moves that can't be attacked with a pawn push if your opponent is playing like this.
2. Try to exploit the weaknesses created with these pawn pushes.
3. Don't castle into a fragile kingside like you did.
4. Make sure everything near your king (and the rest of the board) is defended, unless you have a reason not to (like checkmate).
I'm having some issues at around 600+ ELO with people who go all in from the start. Not scholar's mate (I can beat that easily), but people who push tons of pawns, to the point where all my pieces get stuck, and there's then so much pressure on my king, that I can't defend it. My accuracy tanks massively when I play against people that do this. Playing a normal, principled chess game, I'm normally in the high 70s, or even 80+ percent accuracy. However, against people who go all in, my accuracy is down in the 50s, or even lower at times. It's so frustrating, as according to the computer, my opponents accuracy is also much lower than people I can beat who play normally. Example game attached.