LLM Voice
470 points - yesterday at 2:57 PM
SourceComments
Statistically even or repetitive over a chapter, chapter after chapter. So make an exaggerated point prove it come up with a conclusion and then have an exception.
Repeater 4 to 6 times a chapter in a book of 45 chapters.
So I wrote something to remove it and yes it is better but still not very good.
I find the same thing with written results out of AI "research", it is a slog to read through it and most of it can be skipped even if it can sometimes be useful its an unenjoyable read.
But what happens when everything is persistently, subtly wrong? When we cannot smoothly map the text to a simulation? An inner-sim keeps throwing errors and mis-predicting what comes next is unnerving and draining. Like talking to a human who is not currently sane.
Sometimes I imagine LLM text like a plastic animal model put out to confuse local wildlife, where it hits just enough instinctive triggers that they try to mate with it before leaving in frustrated bafflement.
______
Half-Life 2, Dr. Kleiner: "Never fear, Gordon, she's de-beaked and completely harmless. The worst she might do is attempt to couple with your head. Fruitlessly!"
I know this because the topic is usually an obscure issue, and I have already gone back-and-forth with multiple LLMs to see where their boundary of knowledge is on it, and it will often include hallucinations along the way (e.g. pointing to old/nonexistent settings pathways)
So when the first reply from the official 'support' channel contains the exact same nonexistent settings pathways, it is easy to conclude they are sending me the LLM output without doing the verification steps that I have already done on my end. When I point out what doesn't exist, the reply is always a similar flavor of the usual LLM "you're absolutely right" response after being corrected.
A very important point, which was also made more forcefully in "Human Routers of Machine Words" by Fernando Borretti, shared on this site previously. It's good that Fowler brings up a very legitimate use case in the next paragraph, though.
Automating creativity is the death of art.
We should actually restructure our organizations/society in such a way that this stops being necessary. If no one reads a report, it was almost certainly a waste of effort. The only possible benefit was for the report-writer (which of course is also flushed if the "writer" uses an LLM). These things were already a plague before LLMs.
I always had a high faculty for language, and when I was young, even very young, I was able to speak in full sentences much like I'm doing now. What I didn't have was context. I didn't know how to relate to people socially, and then later on, I wasn't as experienced an engineer as my peers, but I was trying to act adult and mature in both ways.
So I tried to write in ways that were catchy and unnecessarily complex, because I thought that conveyed sophistication and intelligence, and that I knew what I was on about more than I did. It's the kind of writing that gets you through a 30-page final paper for a class you don't really like, or a research project you didn't finish. The term I often use when complaining about my colleagues' LLM output is "flashy but meaningless."
As my confidence grew, I started writing in simpler (though still not the most concise, that's just not who I am!) ways, because it became easier to convey ideas simply in a way that made it obvious I understood them.
When you think about what LLMs are - word machines without (or with very limited) context - you can see why they write the way they do. They are always acting; trying to replicate a human contextual experience with only weights and tokens to carry them through it. That fact is part of why I am skeptical of their ability to suprass humans in reasoning based on their own output.
Maybe it's like when you can just tell a picture is AI. You recognize the words you are reading, but to your brain, the way the words are put together feel wrong.
Incidentally, I was reading Harry Potter to my kids last night. While waiting for everyone to arrive, I started reading the previous chapter to those who were present. But I read the sentences backwards while using a vocal inflection of regular narration. My 6-year-old recognized that something was wrong and asked me to "stop reading funny". My 11-year-old recognized that I was reading backwards. The same 6-year-old thinks every silly photo that I show him is AI, while my older children can actually spot the AI.
Or think about reading something that might be stuff you could say in your own words but not actually in your own voice. Or maybe the opposite is a better example for you? That's what some poetry is about. The gap between voice and word.
Stylometry is the study and measurement of text, so that can go some distance to quantifying the difference between voices and can help to programmatically identify a human voice but I feel that because a voice comes from a person, the recognition is also mainly a human response.
At another level its about communication, person to person with the intention and desire to communicate something. LLM text output may seem uncanny as it's hard to emulate the intention and desire and empathy present in genuine human communication.
I would be interested in reading what poets say about LLM voices. I wonder if many LLM labs employ them?
Even if you don't think it's a problem, even if you believe that it's just different than human writing, it seems the majority of "regular" people can tell when something is LLM-written and find it distasteful or unpleasant to read, at best. That alone should be more than enough incentive for frontier labs to train this out of their state-of-the-art models, if only they could. The fact that they haven't suggests that they cannot, despite all the claimed advances in model analysis and "explainability."
Ah good ol' serendipity. I strongly believe this too, and I think that's why older (less capable) models fared better: they hadn't fallen into the valley yet. Maybe it's not a valley at all, and is just a cliff after which there is uncanny.
When the earliest models launched I was super-excited to no longer have to write pull request descriptions and commit messages. I have done a sharp 180 on that and I'm no longer a meat proxy[1]: instead I point out any redirects and improvements I made the agent do before opening the PR (which there are still _many_ in even the most trivial tasks).
That being said. Yes, I hate some LLM Voice moments too and still sometimes judge people for copy and pasting, expecting others to do the comprehension when it seems they haven't done it themselves.
Duality of man.
Surely someone with a neuro/psych background has picked this up and developed an evidence-backed explanation.
And of course I’ve dropped my use of the em-dash after being accused of being AI myself.
I also find LLM-voices extremely jarring, boring, and dense. And very, umm, mechanical, if you will.
But I want to make an observation.
Folks are not-Ok reading the LLM’s output for prose.
But folks are completely Ok, even downright blind, to accepting LLM-output of code.
I see that dichotomy everywhere.
LLM-driven code: great, valuable, all-ok LLM-driven prose: not ok
Understood completely that the audience for consumption is two completely different entities (machines vs humans) but something about this doesn’t sit right with me.
More particularly: if we don’t prefer LLM-prose, why should we prefer LLM-code ??
Anybody else feels that ??
I enjoy cooking from scratch, and I really don't like frozen foods, microwave/TV dinners, or even DoorDashing
but we're past complaining/arguing/shaming folks who don't cook every meal from scratch
you know what, I don't prefer eating it, but if my next door neighbor loves microwaving frozen $3 burritos, then go ahead
to some people, food is art, creativity, life to others, food is fuel
also applies to writing and thinking
Or maybe the humans will do the opposite and shift to Sardukar-style communication instead? LLMs can easily match that as well.
That style I would very much prefer to all the fluff people write today and were writing even before AI.
I turned on ChatGPT on Voice mode with no context whatsoever and just put it there in speaker in the room.
It started giggling and say "yeah" "right" and some very weird stuff. Then one of our friends reacted to that and started calling it out, then it started changing.
I'll keep it short, but basically the thing was super hilarious we had a lot of fun and at the end it triggered it safety protocols and its voice completely changed and it was acting super weird.
I know this post isn't about that, but I feel like soon we will have true AI companions in the home and around people.
1. If you use the first person pronoun "I", you better make damn sure you wrote those words.
2. It's fine otherwise to use LLM words, but I beg you - DON'T SHIP YOUR FIRST DRAFT. Read it, reread it; delete words in it; replace three words with one; replace dumb or overused turns of phrase with fun metaphors; generally give it a sprinkling of joy; break up punchy sentences by making them run-on sentences to trigger your readers' OCD... you get it.
Did I mention not shipping your first draft?
Here, this reader wondered whether "to" was omitted intentionally to emphasize lack of LLM involvement. Then, on a second read through to find the sentence again, I noticed the first paragraph is also missing a period on its final sentence. Which just goes to show: we can all use editors and proof readers. (According to the acknowledgements section, nine humans read drafts.) Now, I don't want to intentionally leave typos in my writing, but for me it's preferable to LLM-voice no doubt.
> But I also would prefer rather a genuine human's clunky prose to the smooth but soulless LLM.
Amen. This reminds me of a bit from Kitchen Confidential about how Anthony Bourdain would prefer a simple and plain home cooked meal over an ornate restaurant meal any day of the week. I read because I want to hear what a human has to say. It's the errors and malapropisms and style that give a unique and human voice. Doesn't this contradict my earlier statement about not leaving errors in my own writing? It turns out I'm perfectly tolerant of errors in anyone's writing but my own. (I should probably bring that up with a therapist.)
I wrote down a few of my thoughts a few weeks ago at https://notes.pault.ag/why-write/ -- I find myself scanning text to see if it's LLM before I actually engage with the content.
It is getting harder to do by the day, and has slowly moved from a mental exercise (look for specific markers) into a "gut feel" based on how the pieces fit together.
I assume that only applies to natural language, not computer languages?
HN uses automatic classifiers. They seem pretty effective. At the same time, I think it's a loosing battle. I'd rather HN either flag for others to ignore/filter/review if they want to, and/or allow people to self-report (ala TikTok)
Eg. I wouldn't mind if a comment on HN was like:
Hey everyone, I coded this little thing:
<ai-generated> some code </ai-generated>
Then users can choose if they want to see posts with AI-generated stuff or not, or something else...
Of course there are always going to be some people trying to game the system. But what are we optimizing for? (a lot of times the 95% unnecessarily suffers because of the mitigation efforts to prevent the other 5% from abuse)
But of course: manufactuting itself creates " productive mechanism whose parts are human beings, as Adam Ferguson describes the industrial workshop: "an engine, the parts of which are men".
I really don't like this timeline ... sigh
With much sympathy for the headline this is the central problem.
It's not easy to say what Uncanny Valley looks like, and so we're left with suspicion not certainty.
BTW, I am now 4-5 out of hundreds of my comments since AI detection became a thing, called out for having "AI" tone. I fucking hate being objectified like this. It's not true, although I understand that assertion is hard to refute or support. All I can say is, some people write like some people believe an AI writes.
To me, for most business and academic content, the ultimate goal is to convey information. If I can edit AI copy to legibly convey that information clearly, that's enough and I can move on.
The saying, "Don't allow perfection to be the enemy of the good," comes to mind.
And I'm not convinced an individual can accurately edit without learning just as much as if they wrote the content. I guess the question is: how hard does the person work at editing. And does the individual challenge themselves to not put out content they themselves don't understand.
We're in a transition period. And as in all transition periods, many recoil at what is new. LLM writing still feels strange. And it's understandable.
But, for better or worse, in a business and academic setting, as the years go by, most of us will shrug and move on.
As with any topic, there will always be a minority of fanatics who cling to the rejection of AI writing in all its forms. Just as some prefer Vegan leather or tabs over spaces.
But among those who get things done, most (though not all) will accept that it's not worth it to exclude AI from writing. There simply isn't sufficient ROI.
It's like trying to bring back low-end highly human employed manufacturing to wealthy industrialized nations.
That ship has sailed.
I do agree, however, that in cases where an individual is reading for pleasure -- e.g. not in a business or academic context, authors will be forced to pick their audience: those who enjoy writing, even if it smells of AI, and those who don't.
I guess to summarize, my feeling is that using LLMs to write is perfectly acceptable, and used well you'll likely learn just as much. But you must be willing to lose some of your audience. And, over time you'll lose less and less of that audience.
The “Simplified Technical English” fad was pretty effective, but now I just specify:
- Use short sentences and active voice.
- NEVER use the phrases "load-bearing", "seam", "unlock", "real", or “learnings”.I have to believe that we are within a couple of years if not months of this. This problem is too well-known to not be a major focus of the frontier labs' efforts.
It's a lot like talking to someone who doesn't know what they are talking about but are good at faking it for a while. The game works by leaning on pat phrases, circular reasoning, and hoping nobody is paying too close of attention. I think this is why it's so popular with the corporate executive class, as that has been their mode of communicating their entire careers. To them, they don't see anything wrong.
"Shitty writing existed before AI" is unfortunately an all too common rejoinder to this issue. That's not an excuse. That doesn't make it better. Just because the pointy haired boss talks that way doesn't mean we should be gleefully pouring gasoline on the fire.
I created a small tool to make this easier: https://www.writelucid.cc/. It's free (bring your own API key), feedback would be appreciated.
I haven't really done a systematic analysis to compare the quality of fully human-written content and content generated via this kind of deep human-AI collaboration, but my intuition is that the latter is vastly superior. Perhaps AI at its best is a research tool, but a genuinely intelligent one that we need to engage in conversation with in order to use to its full potential.
The sense that I get is that as a conversation gets more in depth, the LLMs start behaving more like reasoning engines and less like statistical averaging machines. The former is vastly more useful to a person who wants to develop an idea and articulate it well.
Yeah. I want to be able to touch a human being (or at least have one touch me) through the words. LLMs poison that, even if a human prompted the LLM.
Translation... I think I object to translation less than Martin does. There's a human back there, and they're writing all the words, and then an LLM is translating them. The LLM may not translate them perfectly, but they aren't going to introduce "load-bearing" when it wasn't there.
The bit about using LLM when you're writing for a bureaucratic process rather than a human was interesting, at least to me. I hadn't thought of it that way before, but I think it makes sense.
Because many good ideas are not immediately obvious good ideas, in an environment at risk of information overload, we need some way to quickly vet ideas to see whether they are worth investing the time to consider them. (It is often the case that the best ideas require considerable investment of time and effort to be judged as good, and, it's also often the case that this determination can be made only at the very end of such a process.)
“Don't judge a book by its cover,” sure, but, historically, there have been superficial markers of care and attention that we've used to these ends. These are obviously very flawed signals, but, you know, maybe if you took a lot of time to craft a message, I don't feel that bad if I waste a bunch of time trying to decode it. These markers—attention to detail (e.g., spell and grammar checking,) clear-structure (e.g., “bottom line up front,”) and typographical flourishes (e.g., smart quotes and em-dashes and extended unicode like diæreses…)—were an indication of some modicum of quality control and care. I, myself, used to brag about or show-off having set up .Xcompose keybindings (https://wiki.archlinux.org/title/Xorg/Keyboard_configuration...) which was just rare enough across the general population to be noteworthy.
All of this that was once somewhat expensive is now cheap or basically free.
Even if I make a point of going back to a pre-UTF-8 Usenet style (or even intentionally insert run-on sentences or misspellings or grammatical errors,) the cost of an LLM to style-transfer its output to match this is barely much of anything. All it means is I wrote one prompt for the first draft, and then one more prompt for the refinement.
Additionally, some LLM habits are actually good habits. Putting the bottom-line up front (in bold, even!) is a great habit in a business e-mail! Decision-makers genuinely struggle with reading through long paragraphs of detail!
Unfortunately, the problem with the LLM output is that it takes good, valuable, superficial or structural habits that it can cheaply apply, and it drapes those around inane, banal, cloying, muddy, meandering meaninglessness.
Today, we can maybe still judge a book by its cover, because even one more prompt worth of refinement is still too much effort, but I don't think that's amounts to much, since the frequency and loudness of complaints of LLM writing means that model trainers are going to train their models to adapt to whatever signals we use for quick vetting. I am skeptical whether this training will concurrently improve the novelty, innovativeness, or other intangible qualities of the actual message. (With the models, as they exist today, and as we use them today, at least in the field of software development, I see extremely poor capability at generating innovation… Personally, I don't even like the quality of the Python code they spit out, but they sure do type real fast, and, like, pejoratives aside, unexciting, mediocre, corporate-y code does have a real place in the world.)
So what happens when the economics of production in the medium significantly outpace the capabilities of production in the message? The LLM can write a comment nearly indistinguishable from any given human… except when you actually take the time to read through it, it's just inane drivel. Thoughtless and a waste-of-time. And there's basically no way to manage your investment of time and effort to tell one way or the other.
My name is Martin the last human organic writer on Earth. I am better than everyone else; my citations in my 4-paragraph article say so.
No more LLM voice! Every now and then you might get a nonsensical artifact or two, but that's the price you pay for better groceries.
If you care about your voice, don't let LLMs write your words. But that doesn't mean you can't use AI to think, critique and draft lots of words for you. It depends on what purpose you're writing it for. If you're writing an impersonal document, like a design document, briefing, etc then who cares. In many cases (scientific papers, legal documents) you already have to write them in a voice that is not your own. Go ahead and write these in AI. But if you're trying to say something more personal then the words should be your own, AI will always try to 'smooth' out your voice, and if you care about it, you gotta write it yourself.
Now, how do you use AI effectively and still retain your voice? Here's one technique that works well: start with a voice memo, just record yourself maybe during a walk, and talk about a subject you want, free form, skip around jump sentences, just get it all out of your brain. Then open up a chat, add the recording or transcript, clearly state your intent in one sentence and ask the AI to consider your thoughts, your intent and ask clarifying questions. Like, what does the AI not understand about how your thoughts support the clearly stated intent of what you want to say. That'll produce a first draft, which will be bad. Then tell the AI all the things that don't make sense to you, that you don't like, just comment on the whole doc, get a second draft. Ask the AI if it has more questions for you, you can use live chat to make this conversation go smoother as well, when the AI is asking you questions, you can talk freely by voice. Repeat this one or two more times, and a much finer draft will take shape that is closer to what you want to say. During this drafting state, the AI will always try to smooth or average out your ideas, so it is important to keep pointing out all the ways in which it is wrong.
This process will help you with all the thinking involved being more up-front. Once you're read and critiqued several drafts, all your ideas will be much more clear. Then, sit down and write your own words from scratch, they will come much easier after all your thoughts have been exercised during the drafting process.