> The distributed build systems only really benefit from aggressively caching the modules that are built, right

Not really, you have more cores to build on. Significant difference for slow to compile languages like C++.

> I may have this totally wrong though. Would distributed builds actually get us a new binary faster to the local machine?

Yes, again, for C++.