We finally have an explanation for what happened. Our site was turned off by our hosts, who couldn't believe the traffic was legit. Maybe time to look for a different hosting company...
For a few days, I've had the problem where the threads page (e.g., https://hackernews.hn/threads?id=zck) takes a long time to load (> 30 seconds), and sometimes doesn't load at all, ending up with just a blank page -- no html is loaded.
Because hacker news doesn't use a database, the site is file driven and runs entirely out of ram. Changes are made in memory and logged to disk and upon server restart, the files are lazily loaded on demand to prevent the need to load the entire db all at once. This might sound crazy but it's actually faster (once loaded) and easier to program than a relational database.
As hacker news was a fun project for Paul, I'd imagine he doesn't want to touch a relational database with a ten foot pole; I don't blame him. You can get a long way without ever using a real database, files and in memory hash tables work fine up to a pretty decent amount of traffic. It only becomes problematic when you need more than one server.
Interesting; I have noticed that once the threads page loads, it generally works fine the second time. I've been trying not to hammer on it too much to see when it works/doesn't work, though.
I guess it's one way to tell if the server's been restarted since I last was here. :)
Yes, that's the problem. We just switched over to serving the static stuff off this server while we investigate. The extra load may make things here a bit slower but the site seems usable.
HN is the single slowest website I use regularly and not just because the www server was cut off today. Typical page loads are 10+ seconds and if I want to view my threads page it usually times out before finishing on the first request (sometimes it's the same for the home page). It's quite absurd considering the audience.
Oh and it took three tries to post this comment, I kept getting timeouts.
Same here. Very slow for me, and when I try to load my comments or submissions pages, I often get a timeout and have to try 2-3 times.
I've always found it a bit ironic that a website where there's probably one of the highest concentration of good coders/web people was so slow and unreliable. But maybe that's just the nature of the beast; reddit is slow too, and they have a lot more resources.
Perhaps it's you, or latency to you, the sites always quite snappy and fast for me and I never see load times like that. Most pages load in 700-800 milliseconds for me and pretty much always have.
From what I've read it's because pg uses this as a playground for arc and is far from optimized. It would be great if he got some help from the community though, it is embarrassingly slow.
Yep, that's a problem for me too. Images and hyperlinks aren't rendering properly. Checked HN in Chrome, Firefox and Safari to make sure, and cleared cache.
A possibly related issue is that I occasionally find myself logged in as someone else when I load the front page (ie some other user's name/karma are displayed in the top right). This goes away after refreshing or loading any other link (so I can't post as someone else, for example).
Plus I get that "unknown or expired link" error sometimes when trying to post (including when trying to post this message). This seems to occur when clicking on a thread from the front page loads an out-of-date version of the thread, and can be fixed by force-refreshing the thread page.
I have been having a lot of stupid caching behavior, too (I think I have a transparent cache between me and yc, and there doesn't seem to be an Expires header. Some article pages show me as logged out, or when I try to reply, I get deleted/expired link message.
It's worth noting that Chromium was still giving me bad images/css even after the outage until I moved to a completely new tab. (Even with trying ctrl+F5, though I'm unsure that Chromium binds that to 'reload + reload cache' like IE did/does.)
https://hackernews.hn/item?id=1283430