Hey man.
You can only use code from repositories whose licenses allow it. Public doesn’t mean free to train on, the license decides.
For example MIT, Apache, and BSD licenses generally permit model training if you keep attribution.
HOWEVER GPL-type licenses have restrictions, and repos with no license can’t be used at all.
Always check the repo’s LICENSE file before using it for training if you dont want legal battles with lawyers and such.