Realize that if you become only barely proficient as far as serious players (tournament players) go, even just 1400, that's still enough to destroy most casual players you'll ever meet. I once had a class-A player tell me that a 1600 was a "decent amateur"...1600 will wipe the floor with anyone who hasn't studied chess seriously, and is still a far cry from master.
You can get plenty good starting in your mid 20s.
Chess is an enjoyable, frustrating, creative, heart breaking, exhilerating game - the age you start doesn't matter - you will experience all of the damned things in time anyway...