>But points of sail don't have any handedness, correct? I.e. they're mirrored on both sides of the wind.

The right-of-way rules in sailboat racing depend on who is on 'port tack' or 'starboard tack' (ie, they differentiate those mirrored halves). There's nothing physically special, though.