Stockfish looked pretty imperfect against Alphazero.
Sure, but imperfection is a low bar.
More to the point, Stockfish looked pathetic after they released an extremely limited set of data which put their product in the best light. People forget that AZ's "crushing" victory was a measly (IIRC) 62% even though SF had questionable hardware -- good enough to be rated only 100 points higher. Overwhelmingly the games were drawn.
I think the hardware has everything to do with it.
LC0 uses the same approach as AZ and is usually regarded as strong, but it also usually runs with a GPU that gives it hundreds or thousands of extra processors compared with probably four used by SF.
I recently tried downloading an LC0 version that runs without video card to see if it played basic endgames any better than SF on the same hardware. The answer was that LC0 is totally useless with the same hardware.
There is no point comparing a software architecure built to run on certain hardware vs inappropriate hardware.
Lco is heavily rely on Neural Network which require parallel/matrix calculations.( gpu's strength)
Stockfish is build on AB search that requires sequential computing ( cpu's main strength)
If you are running Lco on CPU, it means you are asking 10 tons big truck to delivery 1000 envelops into 1000 customers, wheres GPU are like 1000 bikies running parallel to deliver 1000 parcels simulataneoulsy. That is why cpu on lco is way slower than GPU.
If you dont have GPU, dont use Lco- period. It will be 200-400 elo weaker than Stockfish.
I'm not sure what you mean, but we can probably agree that if you want to test your engine vs another person's, then it would be better to have each side choose the hardware and settings they believe are optimal, and then if both sides agree they can have a match.
Not some silly match where your choose the hardware and settings for the opponent, play all the games in secret, and only release a few of them (as AZ team did)
AFAIK NN engines like leela calculate slower (in terms of positions per section)... but that's not a defect, it's just how it operates.