How do I beat the Exchange Variations (in the french and caro-kann)?

Precisely so.
Just play it out on the board and you'll realize Black is way too slow. Keep in mind that Black also wants the LSB outside the pawn chain (the whole point of the Caro), so that'll require a couple of moves too