Just saw this from a friend and now I can't unsee it:
"I just had a weird thought. (LLM type) AI is a lot like torture, in that you'll get an answer that sounds plausible, but might not be true because the victim/AI will give whatever answer it thinks you want.
From now on I'm going to think of asking AI stuff like you're waterboarding a nerdy seven year old."
Stop the AI waterboarding!