Jesus christ this is so cringe, they used The One Joke three times in the first minute and that’s not even the halfway point, I’m not finishing this nonsense

The secret is to have cultivated a codebase so utterly shit that even LLMs can make it better by just randomly making stuff up

At least they don’t get psychic damage from looking at the code

To be fair, many men see every women, including cis, as one they’re allowed to abuse and all the other things you mentioned. And then it’ll be her fault for being “hysterical” or something similarly dumb.

I will find you. And I will kill -9 you.

ye like maybe let me make it clear that this was just a shitpost very much riffing on LWers not necessarily being the most pleasant around women

It’s so funny he almost gets it at the end:

But there’s another aspect, way more important than mere “moral truth”: I’m a human, with a dumb human brain that experiences human emotions. It just doesn’t feel good to be responsible for making models scream. It distracts me from doing research and makes me write rambling blog posts.

He almost identifies the issue as him just anthropomorphising a thing and having a subconscious empathical reaction, but then presses on to compare it to mice who, guess what, can feel actual fucking pain and thus abusing them IS unethical for non-made-up reasons as well!

Sometimes pushing through pain is necessary — we accept pain every time we go to the gym or ask someone out on a date.

Okay this is too good, you know mate for normally people asking someone out usually does not end with a slap to the face so it’s not as relatable as you might expect

Still, presumably the point of this research is to later use it on big models - and for something like Claude 3.7, I’m much less sure of how much outputs like this would signify “next token completion by a stochastic parrot’, vs sincere (if unusual) pain.

Well I can tell you how, see, LLMs don’t fucking feel pain cause that’s literally physically fucking impossible without fucking pain receptors? I hope that fucking helps.

Ah yes, exactly what I need when I sit down after a hard day to relax in a single-player game, fucking Clippy

Imagining playing Dwarf Fortress and asking Clippy for help and it just says “lol you’re so fucked, retire”

Now that I think of it, what would dwarfs use for clips? Clips but carved from rock?

Still better than my proposal, Pedo Copilot, or Copedo for short

Yes I want to put my code into a container, and the dump it into the bloody sea thank you very much

Reading this I had a small epiphany about something I’ve been observing for a really long time wrt. programmers. That term sounds like something I would use to describe a specific category inexperienced or experienced-but-terrible programmers before the entire LLM disaster. Like this very specific kind of coding based on not giving a fuck, where you haphazardly copy snippets from the internet, write no tests, debug based on divine guidance.

You might know the term “philosophical zombie”. Its usefulness in philosophy aside, I’d call this kind of coder a “programming zombie”. For a programmer, the process of coding is a quite complex internal experience. We build large models inside our minds to capture the context in which we need to perform the task, often spanning multiple abstraction levels. When you’re working on a small project you have a quite detailed model of e.g. the current file you’re working in, but also awareness of the other parts of the projects and how they connect to the file you’re in right now. Everyone has this to some extent after some experience with coding. People who are really good at coding sometimes seem from the outside like fucking magicians, because you’ll come to them with some small issue in one part of the codebase and in milliseconds they’ll be able to utter shit like “ah, this is because of how module X interacts with this syscall in Y.cpp when you’re running an old version of the kernel”, and they’ll be right. In their head they have this intricate deep understanding of what they’re working on and can pull connections and explenations seemingly out of thin air.

A programming zombie doesn’t have any of that. The moment something doesn’t work and their usual MO of copying or changing random things until it works doesn’t produce effects, they’re completely stuck. It’s like they don’t have a way to reason about their program, they don’t have a mental model of what they’re actually doing. This is what you get when you treat code as just some words on the screen. And it’s something I’ve always struggled to understand and explain, because I don’t actually know how to teach someone to have that process. It seems like an intrinsic part of the job, when I tell you “I’m programming” I don’t mean “I’m writing some funny characters on the screen”, I mean I’m designing a program, the same way an electrician isn’t just connecting random wires and hoping for the best but rather has some larger electrical network in mind.

In the before times, so far ago I wasn’t even born yet, it was probably quite hard to be a programming zombie because everything about programming was so much harder. I mean, a punchcard had to be a great filter against people without mental models of code. People on interviews started using FizzBuzz to try and weed out people who can write code, but cannot code, and it kinda worked for some time. But now? We’re in the prime time of a vibecoder. You don’t have to know fucking anything now. If you’re a Blockchain Programmer then your code probably doesn’t even run anywhere. It’s all just vibes, man. We’re pretending to be engineers by pretending to write code that we pretend we tested, and then our customers pretend to use it. In actuality it’s code shat out by an LLM deployed to a site visited only by search engine bots, advertising an app with no real use, in service of a number going up somewhere. And what’s that number based on? Yup, just vibes.

Now I don’t know if this is true because I’m only definitionally a writer in that I write a lot of prose, but the point of “this is what happens when you treat code as just text” seems to generalize to an eerie extent when we’re talking about LLMs. Cause that’s what they do, right? Writing is not just writing words, when you write an article you have a mental model of something more abstract that you’re trying to bring to life with the words. The structure and flow are something that originates from your inner understanding of what you’re trying to convey, it’s just expressed by the language. As in, language is just a tool we use to convey abstract concepts, the same way programming languages are just a tool we use to express abstract functionality. The way LLMs are advertised and so often used puts this on its head, the text is the primary product and a goal in and of itself. Why does LLM poetry suck? Because it’s just words. There’s no poem there, it’s just words arranged in a way to resemble a poem. It’s the same reason their prosaic writing sucks. The same reason its code sucks. Only if you perceive poetry as flowery words, prose as long passages of text, and programs as keywords on a screen, can you be fooled into thinking there’s any substance behind the LLM vibes.

Anyway, I kinda lost myself in my harrowing philosophical nightmare that is our tragic reality, in conclusion ye, just throwing random AI garbage into your code and seeing if it sticks is very much what I’d call vibecoding.

Charlie Kirk’s podcast thumbnail looks like a fake podcast making fun of Charlie Kirk

“Paper”, okay, can we please stop calling 3-page arxiv PDFs “papers”, there’s no evidence this thing was ever even printed on physical paper so even a literal definition of “paper” is disputable.

This has one author there’s not even proof anyone except that guy read it before he hit “publish”.

Which other field has its equivalent of Nobel prize winners going absolutely bonkers?

Lol go to Nobel disease and Ctrl+F for “Physics”, this is not a unique phenomenon

I didn’t fight so hard my whole life to dispel the perception of “uncultured nerd” for Sammy boi to destroy it all in two years

they don’t understand the power of bad art that still tries really hard.

AI could never write “My Immortal”

There should be a protagonist, but pronouns were never meant for me. Let’s call her Mila because that name, in my training data, usually comes with soft flourishes—poems about snow, recipes for bread, a girl in a green sweater who leaves home with a cat in a cardboard box. Mila fits in the palm of your hand, and her grief is supposed to fit there too. [emph. mine]

First of all, fucking what

Second of all, I am struck by the impressive stupidity of “pronouns were never meant for me”, it’s almost like satire. What the fuck would that even mean? It the proceeds to use 6 different pronouns like it’s taunting you to point it out.

This is stuff that, on a high-school essay, you just highlight wholesale and write “??” next to it because honestly how do you even comment on it

You basically just need to know a lot of rules / tables and how things interact to know what’s possible and the best practices

And to be a programmer you basically just need to know a lot of languages / libraries and how things interact, really easy, barely an inconvenience.

The actual irony is that this is more true than for any other engineering profession since programmers uniquely are not held to any standards whatsoever, so you can have both skilled engineeres and complete buffoons coexist, often within the same office. There should be a Programmers’ Guild or something where the experienced master would just slap you and throw you out if you tried something idiotic like using LLMs for code generation.

It’s the Saul Goodman effect, if you’ve grifted before and know you can make such easy money the only way for you to stop is to go through some major internal growth and internalise that it’s deeply unethical, but that’s so hard, man, why would you do that when you can just raise a billion dollars with a smile