No PGNs for 2017/07 monthly archives

Sort:
Avatar of walidmujahid

For some users, there are no PGN's in the monthly archive games for 2017/07

 

Two such cases are:

https://api.chess.com/pub/player/propugnator2/games/2017/07

https://api.chess.com/pub/player/walidmujahid/games/2017/07

 

PGNs for the months before and after the 7th month do seem to exits, though.

Avatar of ijgeoffrey

 I don't see any PGNs in 2017/08 or 2017/09 either, on @propugnator2.

Avatar of walidmujahid
ijgeoffrey wrote:

 I don't see any PGNs in 2017/08 or 2017/09 either, on @propugnator2.

Oh, I did not even think of looking forward for him -I just looked at mine and assumed his were the same. The PGNs come back in 2017/10 for him, though. 

Avatar of ijgeoffrey

I wonder why it is intermittent. https://api.chess.com/pub/player/ijgeoffrey/games/2017/07 is fine, and so are all the other months on my own record that I checked. 

Avatar of bcurtis

Thanks for the report. I see the two trouble URLs have a lot of games — over 480 for walidmujahid and over 500 for propugnator2. Other months have fewer. More games take more time to process, and yesterday (about at the time you posted this) we saw a severe load incident on the servers processing these PGNs. Some may have been overlooked. We saw nothing unusual in the logs, but this is my prime suspect right now.

What you can do: for archived game data you can usually expect it to regenerate from source 24 hours later. So as a general rule, if you see bad data, first report it here so we know what we need to look out for as we fix things, and then wait a day and try again. For example, your first like has this header: "last-modified: Monday, 30-Oct-2017 21:35:17 GMT", and so you can expect it to expire and regenerate in 5.5 hours or so.
What we will do: we will add some additional logging for this, so that if it happens again we can collect the data we need to fix it. Once we can see it happening, we can stop it from happening.

 

Thanks for the report!

Avatar of bcurtis

It's a day later, and the data still do not show the PGNs at those URLs. We're looking into it, and will report progress here. Feel free to add any additional URLs that you spot missing the PGNs, and any observations of similarities between the problem URLs.

Avatar of walidmujahid
[COMMENT DELETED]
Avatar of walidmujahid
bcurtis wrote:

It's a day later, and the data still do not show the PGNs at those URLs. We're looking into it, and will report progress here. Feel free to add any additional URLs that you spot missing the PGNs, and any observations of similarities between the problem URLs.

Here are more: 

@dragonknife does not have any pgn's for any month after 07 nor any before 07 until 2017/02

https://api.chess.com/pub/player/dragonknife/games/2017/07

 

@chessguy1012 does not have any pgns for this year or the two last months of 2016 and probably goes back further.

https://api.chess.com/pub/player/chessguy1012/games/2017/07

 

@joseph_truelson does not have any pgn for games after 2017/07 or before it until 2017/05

https://api.chess.com/pub/player/joseph_truelson/games/2017/07

 

@schachmasteo has pgns for 2017/08, and does not have any from 2017/07 until 2017/04

https://api.chess.com/pub/player/schachmasteo/games/2017/07

 

@arnavbatta has games for months directly before and after it. I did not check for archives beyond 1 month before and after, though.

https://api.chess.com/pub/player/arnavbatta/games/2017/07

 

Avatar of bcurtis

We found a number of overlapping issues (bugs, and stability issues) which caused these problems. We believe we have solved everything, and our logging currently tells us that every game delivered over the API is also getting a PGN.

We now consider this bug report closed. Please let us know if you find any others, and we'll re-open to investigate!

Avatar of Tricky_Dicky

Found another archive with missing PGN's

https://api.chess.com/pub/player/cojle/games/2018/05

Previous month and month after both OK.