It's possible you only notice the productivity loss, but the gains are so seamless (sharing a screenshot, a chat that removes the need for a meeting etc.) that they aren't as noticeable.
You can always quit out of the program for a while if you need to really focus, I do that often.