Your opponent didn't play a very challenging line. The most challenging line to face in the London is a c5 d5 Bf5 e6 Qb6 set-up as black.
I play the London and I've got very good results from it. However, it can still be messed up like any other opening. It's easy to get positionally crushed in the London.
I understand what you mean by it's easy for beginners to play because there aren't any well-known traps, but you have to have a good understanding of chess in order to come up with decent plans, and good attacks in the London System.
This is the reason that most teachers teach their students to play 1.e4 because there are more 'tactical' lines for students to win 'faster'.
This is the Deep analysis from chess.com for the london system game I played above.