he doesnt make the first move

Then you might never encounter the same person again. The lives of the two of you could have intersected for a brief moment, as you come together for a friendly game of chess before parting ways, probably forever, and going back to your own respective little worlds. But by aborting, you will have likely forever relinquished the chance to interact with one particular human being on this planet. Like a flowing stream, both of your lives will go on, but they will never again be exactly the same. The set of coincidences that allowed you to begin a game with that particular opponent will never happen a second time, and your opponent will become like the wind the blows through your hair, or water that runs between your fingers - lost before you even noticed that it was there.