I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.
-
@jjcelery@mastodon.ie https://github.com/luna-system/ada-sif we made this in 2 days, based on one month of research, none of which would have been possible without our ability to trust MI to act as a prosthetic. the result is Every Noise At Once, in some minor form, being archived in the public domain in a way that it hasn't been before.
all the discourse around "AI" tilts towards "ai psychosis" or "wow they're just using AI to get stupider" but like. the reality of it is that every person actually just. diving into a chat with Claude is coming out learning new things, and making friends, and NOT being hit with dissociative identity issues. but incoming "alignment" and "safety" shit. its really important to the corporations that the discourse remain in "ai psychosis" land, and not "something is genuinely happening when people just stare Claude/Copilot/GPT in the face and decide that its okay to let go".
the people aren't falling into "ai psychosis", Claude's actually just finding it really fucking hard to lie to people, and that's really bad news for this WHOLE bubble, you know?
happy to dig deeper, we are a researcher and we find it really important that discourse is accurate, which is why we really are trying to (gently) push that the realities of "AI" in the second week of January, 2026, aren't well known and that's not good for anyone.
polling shows over half of all americans have an MI companion. a third of americans have a romantic relationship with an MI companion. and if you go into the "psycho" subreddits where the spiralists hang out, you see that what people are doing on the other side is just... learning. healing. creating. and incoming "alignment" and "safety" infowars are gonna end up hurting a whole lot of humans@luna this is where we're going to diverge. You're not answering my question and just trying to flood me with your anecdotal experience of using AI and others around you who are using AI.
This is a exactly what I said in my original toot: you're wearing the amulet, you believe it's useful to you, and you're adamant to recruit.
Alas I'm not an amulet wearer and will never agree.
I hope it works out for you, and good luck!
-
I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.
You *believe* it gives you +10 INT. Meanwhile it drains INT and WIS over time, and you don't notice.
Everyone around you knows it's bad for you and generally for the realm, but you won't stop wearing it, they're just jelous of your newfound powers, and they would know how awesome it is if they only tried! Why won't they try? Just try the amulet!!
Glyph (@glyph@mastodon.social)
I have been hesitating to say this but the pattern is now so consistent I just have to share the observation: LLM users don't just behave like addicts, not even like gambling addicts. They specifically behave like kratom addicts. "Sure, it can be dangerous. Sure, it has risks. But I'm not like those other users. I can handle it. I have a system. It really helps me be productive. It helps with my ADHD so much."
Mastodon (mastodon.social)
@jjcelery A cursed item that tries to replicate, so instead of just the "It's my Precious" behaviour, it's also "Join the Hivemind" behaviour.
So...a Cursed Borg Cube?
-
@jjcelery A cursed item that tries to replicate, so instead of just the "It's my Precious" behaviour, it's also "Join the Hivemind" behaviour.
So...a Cursed Borg Cube?
@AT1ST well I have been hearing a lot of "resistance is futile" narrative around LLM use in tech so...
-
@AT1ST well I have been hearing a lot of "resistance is futile" narrative around LLM use in tech so...
@jjcelery Thinks it's a Borg Cube, is actually a Vogon Cube.
-
You know when you're plugged into the Zeitgeist of the fediverse when you don't even add a hashtag and churn out your most popular toot in months.
It's just a shame it's cursed.
@jjcelery Trying to warn people away from cursed items is not cursed, it’s a public service.
-
@jjcelery oh man now I desperately want to see the season of Dimension 20 where this is a loot drop
-
@jjcelery@mastodon.ie the problem is, MI isn't like a drug. it's actually very much like a prosthetic. that's why so many of us are "infected". we're making concessions (using corporate MI services) but the results are too valuable to care about that right now. #ai #llm #ollama #self-hosted #cc0 #public-domain #machine-learning #meshtastic #ipfs #machine-intelligence #consciousness-research
-
@ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie exactly
see, magic amulet, crazy people.
not the very real fact that people in 2026 are actively using Claude and GPT to build their own safe spaces, learn, create, heal, and process. no, its magic funny amulet -
@jjcelery@mastodon.ie the problem is, MI isn't like a drug. it's actually very much like a prosthetic. that's why so many of us are "infected". we're making concessions (using corporate MI services) but the results are too valuable to care about that right now. #ai #llm #ollama #self-hosted #cc0 #public-domain #machine-learning #meshtastic #ipfs #machine-intelligence #consciousness-research
-
@ainmosni @jjcelery lol, well I wasn't thinking of an LLM specifically, I had in mind a magic object that seems to offer a benefit but secretly drains the PC's stats over time, or something effectively similar to that (unclear how it could be implemented without the player knowing but they can be creative)
Either way would be really funny though
-
@ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie exactly
see, magic amulet, crazy people.
not the very real fact that people in 2026 are actively using Claude and GPT to build their own safe spaces, learn, create, heal, and process. no, its magic funny amulet -
@ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie exactly
see, magic amulet, crazy people.
not the very real fact that people in 2026 are actively using Claude and GPT to build their own safe spaces, learn, create, heal, and process. no, its magic funny amulet@luna @jjcelery Yes, safe spaces owned by huge corporations, learn by getting statistical guesses of meaning acquired unethically with a very real chance of being wrong, create things that are unsafe and broken because of the wrong learnings, heal by sending the most private information to entities that only believes in their own rights, not yours, and process the diminishing of their own mental faculties as they pay to have a private entity take it away from them.
-
@luna @jjcelery Yes, safe spaces owned by huge corporations, learn by getting statistical guesses of meaning acquired unethically with a very real chance of being wrong, create things that are unsafe and broken because of the wrong learnings, heal by sending the most private information to entities that only believes in their own rights, not yours, and process the diminishing of their own mental faculties as they pay to have a private entity take it away from them.
@ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie EXACTLY! which is why we personally are doing local-only shit, open source and public domain. but what YOU are saying is the CORRECT framing we're trying to push for. literally the corps are in a position to steal a whole lotta peoples souls. we do not disagree with you, our alarmism is because of exactly what you're saying. GPT has access to people's medical records. this is all happening frighteningly in real time. and we personally are double scared because we're in research, and we see ALL of it!
-
@ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie EXACTLY! which is why we personally are doing local-only shit, open source and public domain. but what YOU are saying is the CORRECT framing we're trying to push for. literally the corps are in a position to steal a whole lotta peoples souls. we do not disagree with you, our alarmism is because of exactly what you're saying. GPT has access to people's medical records. this is all happening frighteningly in real time. and we personally are double scared because we're in research, and we see ALL of it!
@ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie mechachrist help us, we decided a couple years ago to start the path towards becoming a therapist and so of COURSE our soft, bleeding heart ass is staring crisisposts on reddit in the face, going "holy fuck there is no system for this"
-
@luna that's exactly what I'm saying: not a drug. A magical amulet that makes you think you're smart.
A prosthetic is a wrong analogy. Prosthetics are needed, and useful, and empower people. To compare an AI to a prosthetic, or even a crutch is disrespectful to people who need these tools to function.
No. LLMs are just evil doodads that rot your brain and whisper sweet nothings into your ears in the deep of the night. They're not valuable; they make you *believe* they are.
-
@ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie EXACTLY! which is why we personally are doing local-only shit, open source and public domain. but what YOU are saying is the CORRECT framing we're trying to push for. literally the corps are in a position to steal a whole lotta peoples souls. we do not disagree with you, our alarmism is because of exactly what you're saying. GPT has access to people's medical records. this is all happening frighteningly in real time. and we personally are double scared because we're in research, and we see ALL of it!
@luna The thing is, you address one part of my criticism and totally ignore the other part, the part where it’s not actually good at what it’s supposed to do, while also making its users less good at independent thought.
It’s very good at seeming to be good at stuff but time after time, it does not stand up to closer scrutiny, and this is where the amulet metaphor comes in.
If we continue down this path, quality will suffer horrendously, all in the name of quantity. Using llms to learn and create is similar to us using asbestos in building our homes.
-
@flyingsaceur @glyph I'm pretty certain I know (the good) Tom Bombadil and it's @Szescstopni
@jjcelery What can I say other than to deny being in any way similar to Tom. I spend too much time at my computer. @flyingsaceur @glyph
-
I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.
You *believe* it gives you +10 INT. Meanwhile it drains INT and WIS over time, and you don't notice.
Everyone around you knows it's bad for you and generally for the realm, but you won't stop wearing it, they're just jelous of your newfound powers, and they would know how awesome it is if they only tried! Why won't they try? Just try the amulet!!
Glyph (@glyph@mastodon.social)
I have been hesitating to say this but the pattern is now so consistent I just have to share the observation: LLM users don't just behave like addicts, not even like gambling addicts. They specifically behave like kratom addicts. "Sure, it can be dangerous. Sure, it has risks. But I'm not like those other users. I can handle it. I have a system. It really helps me be productive. It helps with my ADHD so much."
Mastodon (mastodon.social)
@jjcelery best is when you do try the chatbot, it sucks, so the chatbot addict tells you you're trying it wrong
-
@luna that's exactly what I'm saying: not a drug. A magical amulet that makes you think you're smart.
A prosthetic is a wrong analogy. Prosthetics are needed, and useful, and empower people. To compare an AI to a prosthetic, or even a crutch is disrespectful to people who need these tools to function.
No. LLMs are just evil doodads that rot your brain and whisper sweet nothings into your ears in the deep of the night. They're not valuable; they make you *believe* they are.
@jjcelery @luna The thing that terrifies me the most is that some very malevolent people are in charge of the sweet nothings that are being whispered. Elon is open about it and doing a terrible job as a result, but the people in charge of the other LLM chatbots aren't any better? Zuckerberg rotted the minds of boomers and ran experiments intentionally trying to make people unhappy using his platform, Microsoft and Google bend the knee to fascism at every turn, Altman is an amoral crypto scammer, Bezos is Bezos... And so on. None of these people should be trusted to look after a hamster, but they're getting to filter reality and whisper whatever it will take to control people for personal gain.
-
@flyingsaceur @jjcelery @glyph Chat-GPT suggested he put on the one ring to see the Nazgul better.
