"And if everyone has their own AI running on their own hardware"

Real advocates of open source software long advocated for running software on their own hardware.

And real real advocates of open source software also advocated for publishing the training data of AI models.