Loading a Large Forum

Sort:
cpctc

It takes forever to load a large forum. Why is that? Thanks.

TrueFiction

More "stuff" usually takes longer to load because more code is used for more "stuff".

Hope that helps Laughing

artfizz

Dynamic pagination (see hundred-page-limit).

kco

doesn't he mean it take along time to load up a page ? this is because of your poor internet connection, broadband is better. 

artfizz
kco wrote: doesn't he mean it take along time to load up a page ? this is because of your poor internet connection, broadband is better. 

Not just any page - specifically the page of a large thread. A slow connection would impact the loading of every page.

Perhaps pages of large threads are more likely to contain images (of waffles), video or other non-text?

kco
artfizz wrote:
kco wrote: doesn't he mean it take along time to load up a page ? this is because of your poor internet connection, broadband is better. 

Not just any page - specifically the page of a large thread. A slow connection would impact the loading of every page.

Perhaps pages of large threads are more likely to contain images (of waffles), video or other non-text?


 even with that, my computer with good connection and broadband it got no problem of loading up at all. yes with a slow connection, with those contents it will have an impact on your loading up. 

cpctc

I am using a high speed internet.

cpctc
artfizz wrote:
kco wrote: doesn't he mean it take along time to load up a page ? this is because of your poor internet connection, broadband is better. 

Not just any page - specifically the page of a large thread. A slow connection would impact the loading of every page.

Perhaps pages of large threads are more likely to contain images (of waffles), video or other non-text?


 No. I experience this problem in word associations.

cpctc

Doesn't the computer just have to load the replies of one page, not the entire forum? You only look at one page of a forum at a time.

goldendog
[COMMENT DELETED]
artfizz
cpctc wrote:

Doesn't the computer just have to load the replies of one page, not the entire forum? You only look at one page of a forum at a time.


See post #3. In order to create the page to be displayed, ALL previous pages have to be generated. Otherwise, how would the system know that post 1981 is on page 99?

EternalChess

you see, when a thead is trolled, theres millions of pictures in that thread, making it slower because it has to load the pictures.

cpctc
[COMMENT DELETED]
waffllemaster
artfizz wrote:
cpctc wrote:

Doesn't the computer just have to load the replies of one page, not the entire forum? You only look at one page of a forum at a time.


See post #3. In order to create the page to be displayed, ALL previous pages have to be generated. Otherwise, how would the system know that post 1981 is on page 99?


A non-techy person like me would ask something like

But when I open a file on my computer it knows where it is without having to load anything in sequence.  Why can't separate pages be given separate locations... or does that make a site unwieldy somehow?  Maybe limits certain admin functions involving stats, searches and such?  eg queries like recently posted in.

Cystem_Phailure
SerbianChessStar wrote:

you see, when a thead is trolled, theres millions of pictures in that thread, making it slower because it has to load the pictures.


The actual images would only get called and loaded for the page being displayed.

waffllemaster

So what about my question CP?  Why must it load pages in sequence ... or why can't each page in a thread have its own address?

Cystem_Phailure

In a sense, each page does have its own address.  This link will take you to the 9th page in the linked thread:

http://www.chess.com/forum/view/chess-players/chess-player-of-the-month-june-2011?page=9

But I think the reason they have to dynamically format the pages is because the content can change.  It's not just a matter of adding on new pages as new comments are tacked on at the end, there are changes going on to previous comments from editing by the actual commenters and meddling and censoring by the staff.  Also, the (apparently recently ended) unperson policy means posts would disappear, causing all posts after them to be renumbered and re-positioned in the overall thread.  I think those are the reasons it's set up to recreate the whole thread on the fly.

artfizz
cpctc wrote:

Doesn't the computer just have to load the replies of one page, not the entire forum? You only look at one page of a forum at a time.


artfizz wrote: See post #3. In order to create the page to be displayed, ALL previous pages have to be generated. Otherwise, how would the system know that post 1981 is on page 99?


waffllemaster wrote: A non-techy person like me would ask something like

But when I open a file on my computer it knows where it is without having to load anything in sequence.  Why can't separate pages be given separate locations... or does that make a site unwieldy somehow?  Maybe limits certain admin functions involving stats, searches and such?  eg queries like recently posted in.


The chess.com forum is formatted with 20 posts to a page.

Assuming there are 41 posts in a thread: page 1 will contain posts #1-20, page 2 will contain #21-40 and page 3 will contain #41.

What happens if post #20 get deleted?

All of the posts from #21 onward get renumbered.

Page 1 still contains #1-20 (but it is a different #20).

Page 2 contains #21-40. There is no page 3.

If you ask for the Last Post BEFORE #20 was deleted, you would get page 3.

If you ask for the Last Post AFTER #20 was deleted, you would get page 2.

Similarly, if post #20 was made by someone who subsequently closes his account, post #20 gets hidden and all later posts get renumbered.

Whenever you ask for a page from a thread, the system has to perform a DB query to find the set of posts to be displayed, then paginate those into pages of 20.

The only saving occurs where another person asks for the same page (and no further deletions or hiding has taken place) - the system MAY still have that page cached so may not have to generate it from scratch.

Cystem-Phailure just said this!

cpctc

I thought that if a comment gets deleted, it still is there or still counts as a post.

artfizz
cpctc wrote: I thought that if a comment gets deleted, it still is there or still counts as a post.

I suspect it gets deleted (either immediately or marked for deletion) from the DB.