If your rating is very high then this happens also, however not often. With good players they put a few clever moves and few minutes later they leave the game.
The best way is to wait a couple of hours, in the US players lack time very often. Pretty good players are from Denmark, UK, Turkey, Russia,... Your timezone is important. If you play now, I guess this question is solved.
I just aborted about ten games where unrated players accepted challenges and the abandoned the game without making a move.I have a fairly low rating 1300,are these players just looking for people with higher ratings?