A new wave of AI is poised to transform the technologies we use everyday. Trust must be at the core of how we develop and deploy AI, everyday, all the time. It is not an optional ‘add-on’. Mozilla has long championed a world where AI is more trustworthy, investing in startups, advocating for laws, and… Continue reading About Us
No?
The code for the model can be open-source - and that’s pretty valuable. The training data can be made openly available too - and that’s perhaps even more valuable. And the post-training weights for the model can be made open too.
Each of those things is very meaningful and useful. If those things are open, then the AI can be used and adjusted for different contexts. It can be run offline; it can be retrained or tweaked. It can be embedded into other software. etc. It is definitely meaningful to open source that stuff.
Isn’t AI impossible to meaningfully open source because of how learning models work?
No? The code for the model can be open-source - and that’s pretty valuable. The training data can be made openly available too - and that’s perhaps even more valuable. And the post-training weights for the model can be made open too.
Each of those things is very meaningful and useful. If those things are open, then the AI can be used and adjusted for different contexts. It can be run offline; it can be retrained or tweaked. It can be embedded into other software. etc. It is definitely meaningful to open source that stuff.
Stable Diffusion has entered the chat
There are so many open sourced models out there. Check out the Open Assistant models, Redpajama, etc.