Also, he hasn't attempted to prove that the coin is a fair one. If it always lands tails, it certainly doesn't look like it. I think we should just assume that although everything is neatly laid out in Elroch's logical and mathematical mind, in reality, everything will refuse to comply with Elroch's well-laid plans for it.
You said it yourself, that infinity allows anything that can happen to actually happen.
So either you claim that at some point flipping heads is impossible, or you admit that flipping heads on flip number __ is a 50% chance no matter what number we use to fill in that blank.
And yes, a coin that always lands one way appears to not be fair, but that doesn't have much to do with anything. If you want an answer for how to prove it's a fair coin, you could repeat the experiment many times. The more times you repeat the experiment, the more sure you can be that it's fair. In any case, we can define the coin as fair from the beginning so while it might be a fun question to ask, it's not necessary.
Well, he did try to be more explicit about it, but his language is maybe too technical.
Earlier, IIRC, he did some bijection of sets. One is the natural numbers (1, 2, 3, 4) and one is an infinite string of H and T. Bijection just means to, for example, put the lists side by side and link the first entry of both lists together, the second entry of both lists together, etc.
Elroch was answering your question "how do you know ALL of them are heads when there are infinite of them?" He was saying you can make a well defined list of all coin flips and it's no more mysterious than the fact that we accept there are an infinite number of positive integers.
(So 1 is heads, 2 is heads, 3 is heads, and so on, for all positive integers).