@pravda Well, yes, of course, if »AI« is just a language model, then there are many many examples of nuclear weapons being used in available texts (even hypothetically). That's what's being modeled. There are few texts that contain nuclear weapons and do not talk about their use. So, of course, that's the output.
Why, did someone expect intelligence here?