As I understand it synthetic data and information, and likely also synthetic code, is already used in training of large models.