Support for very large websites

[mvanaken76]

Hi there,
I know: I'm pushing the limits of Publii here, but maybe I'm not the only one.
Here's the deal: I have a website with 13.000 pages and 150 tags and growing. Yes, Publii can handle this website, but loading the list of posts is extremely time consuming, perhaps 3-5 minutes to display the list. I was wondering if there would be a simple way to improve performance, eg. only load the first 150 lines of the list and loads more posts as the user scrolls down? Is this imaginable?
Mathias

[dziudek]

@mvanaken76 - topic of optimization Publii post listing for large websites is in my priority list for next weeks so I do hope I will be able to solve your issues :)

[mvanaken76]

I'll gladly test & give you feedback if it helps. Thanks Tomasz!

[mvanaken76]

When you're at it, please remember that the post list is not the only place where the problem shows up. Also in value lists. Eg. when you're editing the menus and want a menu option to refer to a post, it also takes 5 minutes to open that values list. And each letter you type, to limit the value list, takes another 5 minutes. I ended up editing the menu-file directly outside of Publii.

[michaelfluegge]

@dziudek , wil that include the performance of sites with lots of images?

[bertrand-kaernel]

You can (and you must for performance) limit your page tag like this :

{{#getPostsByTags 150 "lorem,ipsum" ""}}
<li>
    <h2>{{ title }}</h2>
    <div>{{{ excerpt }}}</div>
</li>
{{/getPostsByTags}}

Or in JS but like this is better for performance. After you make a pagination.

[candidexmedia]

13k pages? Wow! What kind of website is it?

[mvanaken76]

It's a database with scans of historic pictures. I want to be able to assign tags to each picture individually and also receive feedback from visitors whereby the picture they are replying to, is identifiable. Therefore, using picture galleries was not an option. 1 picture = 1 post

Mind you, I'm not actually using Publii front-end to create the posts. I'm simply filling the database using a python script that parses Excel-files containing the metadata. It's a really cool project and Publii is nearly 100% up to the job. Only the slow listing of posts is a bugger. But @dziudek is going to fix this soon :)

[bertrand-kaernel]

I guess you know? This should solve your problem : Lazy_loading

[mvanaken76]

@dziudek Hi Tomasz, how is the development going? Could I perhaps "motivate" you with a financial contribution? ;) Let me know!

[dziudek]

@mvanaken76 - first of all - sorry, but I have a delay with this topic. I'm very busy with other (mainly non-Publii related tasks). Definitely this topic is in my list and won't be abandoned, but to be realistic - it will need more time (after initial research I see, that it will be more complicated than I expected).

I do hope that it will be addressed in the upcoming months, because more and more people are asking for it, but at this moment I cannot provide any ETA. Currently I am very busy - I want to come back to this topic max. in few weeks