Warning... This is a "inside blogging" story that may not interest you.
Powerline will soon be unreadable (and unlinkable) for many on the internet. Want proof?
See their January archive, which weighs in at an impressive +4MB per page load. The only way to link to, or read an individual Powerline article is via the monthly archive page. Way back in the ancient history of Wizbang I used software which would not make individual pages for entries and ran into the same problem of page bloat as the month went on. I fixed my problem by changing blogging software to Movable Type. Powerline appears to have brought the problem on themselves by changing some settings in their blogging software - also Movable Type.
With time based archives (like monthly and weekly), each entry is not stored on a separate page, but as part of the whole archive page. In the case of Powerline you now have to load the whole monthly archive page to get to any single article. That's not so bad early in the month, but as content and pictures are added eventually it doesn't load very fast - even for high speed internet users. Dial-up users will get hourglasses instead of content.
Since the front page is set to show a limited number of entries (or days) it continues to load in respectable fashion, but if you try to link to an individual story you're actually linking to the ever growing monthly archive page. I'm not sure what problem they were trying to solve at Powerline when they eliminated individual archive pages, but in the case of a high volume, high traffic site (like theirs) the cure is worse than the disease.
I made a little chart to show the progress of page bloat over the course of a typical month - [graph].
Note: I'm not picking on Powerline - which happens to be one of my favorite blogs - they just made for a fresh example




Comments (17)
Name names, Aleward. What o... (Below threshold)1. Posted by julie | March 10, 2005 5:44 PM | Score: 0 (0 votes cast)
Name names, Aleward. What other blogs have the same problem? I always thought it was me, then the page design, when it took forever to access certain blogs.
1. Posted by julie | March 10, 2005 5:44 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 17:44
2. Posted by McGehee | March 10, 2005 5:51 PM | Score: 0 (0 votes cast)
When I was using MT on my previous host, I got the bright idea that I could save server space by having my archives all monthly rather than individual-entry -- thus not having multiple complete copies of each post. I wasn't even all that prolific, but the same month I made that change, I exceeded my bandwidth limit.
I changed back in a hurry, made a minor adjustment to the monthly archives, and stayed within both the bandwidth limit and the storage limit for as long as I stayed with MT.
Of course, ExpressionEngine is PHP-based, so I don't have to worry anymore about multiple copies of each post. If server space is an issue for them, the PowerLine guys should consider migrating to a PHP-based platform.
2. Posted by McGehee | March 10, 2005 5:51 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 17:51
3. Posted by Henry | March 10, 2005 6:21 PM | Score: 0 (0 votes cast)
the blogger software allows you to select between weeks or months
3. Posted by Henry | March 10, 2005 6:21 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 18:21
4. Posted by -S- | March 10, 2005 7:24 PM | Score: 0 (0 votes cast)
What Henry wrote (^^). It's a very simple matter with MT to select individual archives as display option and then to create a template for the display. Simple as piiieee.
PowerLine has more than a few technical glitches in their site design. Just saying, they might want to spend a bit more time fine tuning what they have, given their content popularity.
4. Posted by -S- | March 10, 2005 7:24 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 19:24
5. Posted by Jeff Harrell | March 10, 2005 7:27 PM | Score: 0 (0 votes cast)
I've gotta say, I rarely read Power Line these days for two reasons. First, like you point out, Kevin, the absence of individual archives makes the blog a little user-unfriendly.
But the bigger problem from my point of view is their feed. I use a feed reader to read blogs, and blogs that don't deliver at least enough content to get a good idea what the article is about, I rarely bother to click through. Power Line only delivers about 20 words on their feed, making it practically impossible to tell what the article is about without firing up a Web browser.
I totally understand folks who don't want to send full content out via their feed, but they could at least go to the trouble of offering useful excerpts.
I love Power Line … but they could be easier to read.
5. Posted by Jeff Harrell | March 10, 2005 7:27 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 19:27
6. Posted by M.Palmer | March 10, 2005 7:47 PM | Score: 0 (0 votes cast)
that graph is high tech.
6. Posted by M.Palmer | March 10, 2005 7:47 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 19:47
7. Posted by Matt | March 10, 2005 8:03 PM | Score: 0 (0 votes cast)
Maybe this doesn't concern the big boys like Power Line, but I'd worry about my bandwidth if, everytime a reader wanted to see one of my old posts, he had to open an entire weekly or monthly archive. That's gotta be costing them some money, doesn't it?
7. Posted by Matt | March 10, 2005 8:03 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 20:03
8. Posted by Mike | March 10, 2005 9:59 PM | Score: 0 (0 votes cast)
The problem with Movable Type is that, unless you have the templates set up right, the same non-post markup (HTML) is in every archive file. Power Line has over 7600 entries -- that's a lot of repetitive markup taking up space on the webserver.
Switching to a PHP-based tool would be a good idea. Personally, I recommend WordPress.
8. Posted by Mike | March 10, 2005 9:59 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 21:59
9. Posted by Remy Logan | March 10, 2005 10:42 PM | Score: 0 (0 votes cast)
PHP/MySQL based programs are definitely the way to go. They are much easier to work with when doing a backup, changing servers, and make site wide changes. The downside though is that you have to learn a new thing or two.
MT is just so Y2K.
9. Posted by Remy Logan | March 10, 2005 10:42 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 22:42
10. Posted by Eric Anderson | March 10, 2005 10:45 PM | Score: 0 (0 votes cast)
The advantage of not having individual pages is that when someone is referred to an individual article, they are more likely to read the other articles. It also helps put the article in context when you can easily look up and down and see what was posted before and after it.
I prefer individual pages and use wordpress which handles them easily. If you choose to go without them, you should split the archived pages up into managable sizes depending upon your output quantity.
10. Posted by Eric Anderson | March 10, 2005 10:45 PM |
Score: 0 (0 votes cast)
Posted on March 10, 2005 22:45
11. Posted by Mike | March 11, 2005 12:22 AM | Score: 0 (0 votes cast)
Or have them use a different template that doesn't show excess stuff (such as a sidebar).
11. Posted by Mike | March 11, 2005 12:22 AM |
Score: 0 (0 votes cast)
Posted on March 11, 2005 00:22
12. Posted by ibejo | March 11, 2005 6:36 AM | Score: 0 (0 votes cast)
I used Pmachine Pro for a while and upgraded to Expression Engine 1.2.1 - it is awesome. Does everything you need and more. If you are comfortable with php and css, you can literally do anything with it. If you are not inclined and just want to use one of their base templates (15 of them to select from) - you can be up and running in 15 minutes. Highly recommended.
12. Posted by ibejo | March 11, 2005 6:36 AM |
Score: 0 (0 votes cast)
Posted on March 11, 2005 06:36
13. Posted by R. Alex | March 11, 2005 11:32 AM | Score: 0 (0 votes cast)
The biggest example of this has gotta be Volokh Conspiracy. I rarely link to them (or discuss their very thoughtful posts) for this reason.
13. Posted by R. Alex | March 11, 2005 11:32 AM |
Score: 0 (0 votes cast)
Posted on March 11, 2005 11:32
14. Posted by Jeff Harrell | March 12, 2005 1:18 AM | Score: 0 (0 votes cast)
Sorry to come back to this so far after the fact, but Mike, Movable Type doesn't have to work that way. My site runs on TypePad, which is a hosted Movable Type service, and each individual archive page consists only of the actual article content itself and a few hundred bytes of other stuff. Most of that other stuff is server-side include directives. My masthead, my rail and other static components are stored as HTML files that get included by the Web server.
Much neater and cleaner than database-backed interpreted solutions. And most importantly, my site stands up under load. You think an Instalanche is a stress? I got Slashdotted tonight. My site was never even sluggish because apart from the very light-weight server-side includes, there's no actual processing going on when my site serves up a page.
14. Posted by Jeff Harrell | March 12, 2005 1:18 AM |
Score: 0 (0 votes cast)
Posted on March 12, 2005 01:18
15. Posted by andy | March 12, 2005 2:31 AM | Score: 0 (0 votes cast)
Oh, that's weird. It didn't used to be like that - individual articles used to be linked individually... like, say:
http://www.powerlineblog.com/archives/003497.php
Wonder why/when they changed it?
15. Posted by andy | March 12, 2005 2:31 AM |
Score: 0 (0 votes cast)
Posted on March 12, 2005 02:31
16. Posted by Jay Allen | March 12, 2005 3:36 AM | Score: 0 (0 votes cast)
Kevin, try switching to dynamic archives and use a PHP include to pull in your header and footer (which you can output as a static index template (yes, Movable Type allows you to choose which templates should render statically vs dynamically).
That way, you will waste the minimum of space (only in the form of a cache of post content) and get all the benefits of the PHP side of life...
16. Posted by Jay Allen | March 12, 2005 3:36 AM |
Score: 0 (0 votes cast)
Posted on March 12, 2005 03:36
17. Posted by Mike | March 12, 2005 10:32 PM | Score: 0 (0 votes cast)
Jeff,
You're right, MT *doesn't* have to work that way. It's been over a year since I last used MT, so I was misremembering.
That said, it's possible for someone to set up their templates to use the same code (for a masthead, sidebar, etc.) in every file. Now that I think about it, though, I don't think MT's default templates ever did that, though.
I think Power Line would be fine if they switched back to individual archives and moved as much of the static content into files to be pulled in via include directives. But they're hinting that they'll be moving to new software in the near-future, so they're likely well ahead of all of us on this.
Server-side includes are great, though, aren't they? *grin* (Though I prefer the PHP version, as I can never remember the syntax for the Apache one.)
17. Posted by Mike | March 12, 2005 10:32 PM |
Score: 0 (0 votes cast)
Posted on March 12, 2005 22:32