My opponents clock runs out but I lost the game

So every now and then I will encounter this issue where I try to castle queen side but it will revert that move, I do it again and it castles correctly. My opponents timer is running but they are not making a move. So I wait until their timer runs out and at the end there is no box saying that I won the game.

After going into the Archive it says that I lost the game, after clicking on the game it shows that it was my time that ran out and not my opponents and the last move was the bugged O-O-O that is not displayed. So on the board it looks that I didn't castle and my timer was running, but what I see is that I castled and that my opponents time is running. I tried making a move after castling but it wouldn't let me.

This has happened about 3 times on different days now and is really annoying. Is there anything I can do?

Happened 5 out of my 6 previous games...Hopefully they ll fix the bug soon because you straight up lose the game!