> keeping bad people from using the model in bad ways

We don't need AI to or block AI from writing rape scenes. Some very highly regarded books[1][2] feature very vivid rape scene of children.

[1] https://www.amazon.com/dp/B004Q4RTYG

[2] https://en.wikipedia.org/wiki/A_Time_to_Kill_(Grisham_novel)