I remember seeing that, you're right. I believe it's actually in Extreme Programming Explained, or in one of those other core books. If I recall correctly, the guideline was to avoid pair work at maximum intensity for longer than 4 hours (small breaks are implied).