> By not writing bad software. State shouldn't be stored in URLs, it should be stored in cookies.
GAH!! So it's you who writes those horrible sites?
I want to be able to middle click on two different URLs and browse two pages with completely different state at the same time.
I HATE sites that store state in cookies, the two different tabs start getting completely mixed up about where I am in the site.
The only thing that should be in a cookie is stuff like a shopping cart. But that's only because the action "add to cart" is like a transaction and should be remembered.
Viewing a page and changing the sort is ephemeral and should have no effect on anything else.
> Spiders have to be robust
Who cares about the spider? What about your site that got hit with an unending stream of completely useless page views?
Your position about robots.txt is simply wrong and you need to change your mind.
GAH!! So it's you who writes those horrible sites?
I want to be able to middle click on two different URLs and browse two pages with completely different state at the same time.
I HATE sites that store state in cookies, the two different tabs start getting completely mixed up about where I am in the site.
The only thing that should be in a cookie is stuff like a shopping cart. But that's only because the action "add to cart" is like a transaction and should be remembered.
Viewing a page and changing the sort is ephemeral and should have no effect on anything else.
> Spiders have to be robust
Who cares about the spider? What about your site that got hit with an unending stream of completely useless page views?
Your position about robots.txt is simply wrong and you need to change your mind.