> the former is scalable at least,

I’d argue that it’s not due to communication costs. The more you attempt to parallelise a problem the harder communication gets.