> In a post on his blog, software engineer Indradhanush Gupta writes that he is no longer crediting Anthropic’s Claude on his code changes, because "adding an LLM as co-author gives you a way for you to shirk responsibility for mistakes." Pressed by commenters that this sounds like a pretext for hiding LLM use, Gupta insists that it is not.
I use LLMs every day at work. At the same time, I've never had an LLM appear as a "co-author", not because I'm making any effort to hide my LLM use, but because I've never been comfortable letting an LLM commit code. I use staging changes, hunk by hunk (or sometimes even line-by-line), as my review process. I don't want LLMs performing any git operations that add or push commits. I imagine I'm not the only one.
PS: If you want some bumpers to help avoid having your LLMs commit code, configuring Git for commit signing and blocking access to your signing key, agent socket, write access to your local Git config, etc., is pretty effective in my experience.
caaqil 12 hours ago [-]
> I don't want LLMs performing any git operations that add or push commits.
Why not? It seems rather odd to let it generate code but draw the line at git commands. Maybe a quick reminder that git operations have detailed history and are entirely reversible is in order.
Do you even LLM at that point?
denkmoon 9 hours ago [-]
They wrote the words right there, in their post, on the page. They use it as a review process. I do too. If it makes it into a commit, I know I've looked at it and at the very least decided "this isn't too awful to commit".
hatthew 13 hours ago [-]
This article is chock full of interesting links. The link about Kenyan English/LLMs [0] describes something that feels like it should have been obvious to me.
Nothing wrong with LLM textual content per se. Current LLMs simply cannot produce sufficient quality of it. And the problem is that P(garbage|LLM) is so high that P(LLM) means you're going to extract a small amount of content from it.
However, there is another problem: first-party content becomes unreliable. "I looked at X and when I did Y, I noticed that a dropped by b%". Vast amounts of such content can be generated that are now plausible. Humans were not so good at producing sufficiently convincing information here, but LLMs are, so my heuristics required to filter down input to manually review are no longer effective.
For my part, I try to write human-directed content when intended for humans, but I have a large machine-curated knowledge base of machine-written content that I consume through a machine intermediary. In some future, I'm sure that machines will perform better at communication, and so the writing will improve, but the provenance of first-party information cannot be solved now. I hope someone figures out a new mechanism to transmit facts to others interested in those.
3edd1 9 hours ago [-]
Well you need to invent a new proxy: the shorter the content the higher the value.
Its not rocket science fella... the irony is this is the heuristic that should've always existed.
I have a pre-determined length Im willing to read, if someone can 't boil it down to meet my max length, I wont read it - it goes in the trash. Job done and not my problem.
I run a firm and this is a rule - if you don't adhere you get fired.
analog31 8 hours ago [-]
I've learned to boil stuff for managers down to just a few bullets.
Er, I mean bullet points.
And no equations.
ChrisMarshallNY 14 hours ago [-]
I've been increasingly letting the LLM take the wheel, in my coding. It's working out very, very well.
I undersign everything under my imprimatur; LLM, contract programmer, intern, whatever. If it has my chop; it has my support and accountability.
The "A" word (Accountability) has been getting deprecated far longer than LLMs have been around. It seems that no one wants to stand behind their work, anymore; regardless of how that work was done.
I had the advantage of spending almost 27 years, at a company that really made sure that I was Accountable. I ran a team, but it was my butt on the line.
dominotw 14 hours ago [-]
dont understand what point you are trying to make
ChrisMarshallNY 13 hours ago [-]
That's the problem.
People no longer understand Accountability.
If I sign off on something; no matter how it was made, it's my ass on the line. If I trust a shyster, and sign off on junk, then I walk the plank, not the shyster.
Legal people have known this for hundreds of years, but tech people seem to have forgotten it.
TL;DR: the process matters less than the result (although good results come from good processes). If someone is known for reliably producing good results, then their personal brand becomes a valuable currency. Classic stuff.
The tech industry has become so tied up with producing junk, that it has atrophied its sense of integrity.
pixl97 13 hours ago [-]
>People no longer understand Accountability
A fish rots from the head. The increase in recording and reporting has shown us the people at the top are rarely held accountable and make billions doing so. Why follow the rules if it's going to financially harm you. It's every industry.
scheme271 11 hours ago [-]
Funny, there's been quite a few incidents where AI has made up case citations in briefs submitted by attorneys and then the same attorney submitted a LLM generated brief with similar errors when asked to defend themselves from sanctions.
13 hours ago [-]
13 hours ago [-]
darthoctopus 13 hours ago [-]
"it's ok when _I_ use LLMs"
edit: you're making literally the same argument that Provost Santiago Schnell is quoted as making in the article, and the entire article is dedicated to dismantling it. Please have a read.
ChrisMarshallNY 13 hours ago [-]
Nope. Try again.
[EDIT:] I did read it (it's fairly...prolix).
It appears that you might benefit from giving the ol' Ts and Cs of this site a quick shufti. I'm pretty sure that I remember them mentioning "did you read the article" as a Bozo no-no.
I specifically mentioned that I use LLMs in my work (which was what he was writing about, anyway), and, as you would expect, it got a few moldy tomatoes thrown my way.
zugi 7 hours ago [-]
> Software engineers who use LLMs should save a curated prose document describing the software, alongside the code that was generated from it.
That sounds great! Though software engineers are all about being lazy - typically in a good way. So I expect in practice they'll use LLMs to generate some code, iterate a few times until it works well enough for them, and then have the LLM generate "a curated prose document describing the software..."
argee 7 hours ago [-]
It doesn't sound great to me. That would be a bit like if I asked my contractor to read a 500 page tome instead when he wanted to come look at the studs in the walls, because the original architect made an incomprehensible mess of it.
elliotmr 11 hours ago [-]
I'm interested in people's thoughts on the basic question: If I write something and ask an LLM to edit or critique that piece, is it LLM generated or is it mine?
I usually follow this procedure for formal emails. I write an initial draft and ask an LLM for a review. I iterate several times as I frequently feel that the LLM has changed a subtle meaning or makes a specious argument that isn't in line with what I want to communicate.
If I could afford a full-time copy editor, I’d use one for the same reason. I am just trying to convey my meaning accurately and I believe that I get more precise results with an LLM helper.
TDelta2258 10 hours ago [-]
I would say it depends on what kind of text the LLM returns to you and what you do with it. If you're only receiving feedback and suggestions, and making the edits yourself, I would say that the final result is your writing. If you're asking the LLM to do a rewrite, and you're checking its results before sending it off as your own, then that's a bit blurrier... Like, if you gave that task to an actual human, would they need or expect to be credited as a ghost writer?
Personally, I use LLMs for writing assistance as well, but I never ask it to generate text. I only ask it to:
1. Do basic copy editing. I give it a version of my document with prefixed line numbers, and ask it to find any typos, grammatical errors, or "hard to parse" sentences, and then generate a table of lines with issues. I make all of the fixes myself.
2. Do style and sentiment analysis. I previously worked as a tech writer (design docs, test reports, policies, etc...), so my natural style has become incredibly dry. Too dry for what I try to write these days. So I ask the LLMs for feedback on readability, voice, descriptiveness, emotion, etc... Yes, I know they're not actually "performing" reviews, but there must be enough literary and language analysis embedded within the models that they can take my text and return an appropriate response. They provide basically the same feedback that I've received from actual human readers (mostly that my writing is too dry...), but they're obviously a lot faster. I specifically ask it not to provide suggestions for changes to the actual text.
jval43 8 hours ago [-]
I recently generated a "plain English" document out of a huge technical spec, and steering this process was the main time sink.
Opus 5.5 will make broad changes in meaning and scope, but subtly. A human copy editor would at least pause before making claims unsupported by evidence (unless they're marketing); an LLM will happily fill in the gaps. Adversarial checks are helpful but have limits.
Unfortunately, I believe most people's command of written language is simply limited (including their native tongue), so they genuinely don't notice or care.
Using a copy editor in the way you describe is sensible, but I suspect many people will just do one pass and blindly apply every suggestion.
exmadscientist 8 hours ago [-]
My personal opinion is that, under reasonable circumstances, if you type the words yourself (that is, if your fingers make the keyboard clack), you own them. That definition explicitly excludes copy-and-paste.
The simple act of forcing a roundtrip through your brain and muscles might seem like a small barrier, but I think it's actually a big step in terms of forcing you to interact with the text and take ownership. It's also not practical to do for large blocks of text, and likely will find you putting your stamp on and slightly rewriting even medium-length passages. Both of which are features of the definition.
7 hours ago [-]
samusiam 10 hours ago [-]
It's no different than having a human editor.
1asgtq 13 hours ago [-]
Academics have completely lost it. The number of mathematicians who write with LLMs and are rationalizing their usage is frightening.
And they have the audacity to claim that the public will defund them if they don't use new tech. No, the public will defund you if you continue cheating like a 10 year old and you are evidently superfluous.
Just say no!
rubikscube09 13 hours ago [-]
PhD student in math here. Doing LLM math is soulless and takes most of the fun out of solving difficult problems (for the most part - my opinion only, I'm happy to talk to mathematicians who like this kind of work). But ultimately the public funds us to produce and understand as many mathematical results as possible for downstream use (if you ask OpenAI/Anthropic, to cure cancer). In that case it doesn't matter who figures a result whether it be a human, LLM, or dog.
So what are we to do? Follow our duty to the community and the public, which is to produce as many results as possible? Or to follow our duty to ourselves and enjoy and understand what we are doing? To someone like me those things seem to be incorrigably opposed to each other now. At this pint the only option is to quit and find a new domain where human input in problem solving is still necessary.
12989575 12 hours ago [-]
I would suggest that hardly anyone in the public is asking you to increase efficiency. That is the argument you read on pro-AI VC forums and Reddit.
In other words, it is a made-up argument. I think some mathematicians are either addicted (Feynman disease) or hope to make a breakthrough and somehow get credit. So they use "the public" to justify their habit.
The real public that is not on these forums wants academic freedom and independence from corporations. Both will suffer if you are entering soulless production pipelines.
clickety_clack 11 hours ago [-]
The “real public” wants math to advance so that we can reap the benefits. We don’t care what tools you are or are not using, grant money will go to whichever group is making more progress.
rubikscube09 11 hours ago [-]
Eh, mathematicians themselves have started embracing it. Terence Tao talks about how LLMs will be on the frontlines, proving new results and humans will just be there to digest and explain them (if the LLMs don't end up being able to do that as well). It's valuable work but not what I really signed up for.
skybrian 12 hours ago [-]
I suspect that the mathematicians who adapt best to AI will treat it like astronomers treat a telescope, as a source of possibly-interesting data to be analyzed. Maybe it looks like finished output, but that doesn’t mean it’s ready to show.
rubikscube09 12 hours ago [-]
Sure, this is in agreement with some people's view that math will become an empirical science. Basically humans probing/mining the brain of an LLM.
mistrial9 12 hours ago [-]
please do not quit
rubikscube09 11 hours ago [-]
Don't really see much of a reason to keep going. LLMs basically have the whole mathematical corpus internalized, and can just practice endlessly through RL self play and autoformalization. Don't really see what my role would be in such a process other than passive appreciation and digestion.
r_lee 10 hours ago [-]
yeah, I don't see how people say that but then don't understand that fighting against the system almost never goes well.
I feel like same thing is happening to software. some people saying how they barely use AI, or how you can just do 10-100x more yet nobody seems to know where that demand will come from
rubikscube09 5 hours ago [-]
maybe demand will catch up over time. who knows. same thing probably happened with mass production of clothes and whatnot.
3edd1 9 hours ago [-]
But someone can just prove whether its possible to 10x no?
Put out completed projects w.r.t products people are familiar with. E.g. show me that you can put out a scalable clone of IG...? Why don't these examples exist?
Like come on, I would LOVE to see that! The average person doesn't care about pet projects. Show something people are familiar with, and use on a regularly basis, that can be produced in a fraction of the resources.
idont363 13 hours ago [-]
“Cheating”? I expect academics to pursue objective excellence in whatever shape or form it comes and not just the artisanal handwritten medieval nonsense shape.
Stop crying and start producing. The time to talk was five years ago. Everyone is way, way too tardy to the party.
It’s the same with developers: oh, but everything will collapse and nothing will work right without us manually signing off on this divinely ordained logic. Well, guess what? Nothing happened and things actually improved. Take a good hard look at software dev over the last ten years and tell me it was fine.
I am not at all convinced the current gen professionals are getting us to where we need to go.
qw21238 13 hours ago [-]
[flagged]
matt3210 14 hours ago [-]
Tools can’t have credit, only
People.
whoamii 13 hours ago [-]
But people are tools, usually
bassie123 13 hours ago [-]
I wonder what it was like when we first got calculators; people saying its cheating at arithmetic. AI is just the next tool humans can apply to problems to solve.
matt3210 10 hours ago [-]
false equivalency
12989575 12 hours ago [-]
Wow, AI is a tool. I have never heard that one before!
No, I don't think calculators were associated with cheating. More with a skill atrophy.
Stockfish on the other hand is of course associated with cheating because it does all the work, unlike calculators.
98codes 12 hours ago [-]
You're telling me this author uses that many em-dashes in their normal writing?
Why not? And Pangram thinks it’s 100% human-written.
warkdarrior 14 hours ago [-]
> Then we can all asses how useful they really are.
Clearly not written by LLM. (NB: emphasis mine)
ramesh31 11 hours ago [-]
Pangram et. al are complete total nonsense. The academic world was trained for decades to rely on tools like TurnItIn.com because they were fairly reliable; searching for hashes of known text is a simple tractable problem, and so being non-technical they've conflated the two. There's no going back now unless you are performing pencil and paper proctored exams.
Rendered at 09:33:19 GMT+0000 (UTC) with Wasmer Edge.
I use LLMs every day at work. At the same time, I've never had an LLM appear as a "co-author", not because I'm making any effort to hide my LLM use, but because I've never been comfortable letting an LLM commit code. I use staging changes, hunk by hunk (or sometimes even line-by-line), as my review process. I don't want LLMs performing any git operations that add or push commits. I imagine I'm not the only one.
PS: If you want some bumpers to help avoid having your LLMs commit code, configuring Git for commit signing and blocking access to your signing key, agent socket, write access to your local Git config, etc., is pretty effective in my experience.
Why not? It seems rather odd to let it generate code but draw the line at git commands. Maybe a quick reminder that git operations have detailed history and are entirely reversible is in order.
Do you even LLM at that point?
[0]: https://marcusolang.substack.com/p/im-kenyan-i-dont-write-li...
However, there is another problem: first-party content becomes unreliable. "I looked at X and when I did Y, I noticed that a dropped by b%". Vast amounts of such content can be generated that are now plausible. Humans were not so good at producing sufficiently convincing information here, but LLMs are, so my heuristics required to filter down input to manually review are no longer effective.
For my part, I try to write human-directed content when intended for humans, but I have a large machine-curated knowledge base of machine-written content that I consume through a machine intermediary. In some future, I'm sure that machines will perform better at communication, and so the writing will improve, but the provenance of first-party information cannot be solved now. I hope someone figures out a new mechanism to transmit facts to others interested in those.
Its not rocket science fella... the irony is this is the heuristic that should've always existed.
I have a pre-determined length Im willing to read, if someone can 't boil it down to meet my max length, I wont read it - it goes in the trash. Job done and not my problem.
I run a firm and this is a rule - if you don't adhere you get fired.
Er, I mean bullet points.
And no equations.
I undersign everything under my imprimatur; LLM, contract programmer, intern, whatever. If it has my chop; it has my support and accountability.
The "A" word (Accountability) has been getting deprecated far longer than LLMs have been around. It seems that no one wants to stand behind their work, anymore; regardless of how that work was done.
I had the advantage of spending almost 27 years, at a company that really made sure that I was Accountable. I ran a team, but it was my butt on the line.
People no longer understand Accountability.
If I sign off on something; no matter how it was made, it's my ass on the line. If I trust a shyster, and sign off on junk, then I walk the plank, not the shyster.
Legal people have known this for hundreds of years, but tech people seem to have forgotten it.
TL;DR: the process matters less than the result (although good results come from good processes). If someone is known for reliably producing good results, then their personal brand becomes a valuable currency. Classic stuff.
The tech industry has become so tied up with producing junk, that it has atrophied its sense of integrity.
A fish rots from the head. The increase in recording and reporting has shown us the people at the top are rarely held accountable and make billions doing so. Why follow the rules if it's going to financially harm you. It's every industry.
edit: you're making literally the same argument that Provost Santiago Schnell is quoted as making in the article, and the entire article is dedicated to dismantling it. Please have a read.
[EDIT:] I did read it (it's fairly...prolix).
It appears that you might benefit from giving the ol' Ts and Cs of this site a quick shufti. I'm pretty sure that I remember them mentioning "did you read the article" as a Bozo no-no.
I specifically mentioned that I use LLMs in my work (which was what he was writing about, anyway), and, as you would expect, it got a few moldy tomatoes thrown my way.
That sounds great! Though software engineers are all about being lazy - typically in a good way. So I expect in practice they'll use LLMs to generate some code, iterate a few times until it works well enough for them, and then have the LLM generate "a curated prose document describing the software..."
I usually follow this procedure for formal emails. I write an initial draft and ask an LLM for a review. I iterate several times as I frequently feel that the LLM has changed a subtle meaning or makes a specious argument that isn't in line with what I want to communicate.
If I could afford a full-time copy editor, I’d use one for the same reason. I am just trying to convey my meaning accurately and I believe that I get more precise results with an LLM helper.
Personally, I use LLMs for writing assistance as well, but I never ask it to generate text. I only ask it to:
1. Do basic copy editing. I give it a version of my document with prefixed line numbers, and ask it to find any typos, grammatical errors, or "hard to parse" sentences, and then generate a table of lines with issues. I make all of the fixes myself.
2. Do style and sentiment analysis. I previously worked as a tech writer (design docs, test reports, policies, etc...), so my natural style has become incredibly dry. Too dry for what I try to write these days. So I ask the LLMs for feedback on readability, voice, descriptiveness, emotion, etc... Yes, I know they're not actually "performing" reviews, but there must be enough literary and language analysis embedded within the models that they can take my text and return an appropriate response. They provide basically the same feedback that I've received from actual human readers (mostly that my writing is too dry...), but they're obviously a lot faster. I specifically ask it not to provide suggestions for changes to the actual text.
Opus 5.5 will make broad changes in meaning and scope, but subtly. A human copy editor would at least pause before making claims unsupported by evidence (unless they're marketing); an LLM will happily fill in the gaps. Adversarial checks are helpful but have limits.
Unfortunately, I believe most people's command of written language is simply limited (including their native tongue), so they genuinely don't notice or care.
Using a copy editor in the way you describe is sensible, but I suspect many people will just do one pass and blindly apply every suggestion.
The simple act of forcing a roundtrip through your brain and muscles might seem like a small barrier, but I think it's actually a big step in terms of forcing you to interact with the text and take ownership. It's also not practical to do for large blocks of text, and likely will find you putting your stamp on and slightly rewriting even medium-length passages. Both of which are features of the definition.
And they have the audacity to claim that the public will defund them if they don't use new tech. No, the public will defund you if you continue cheating like a 10 year old and you are evidently superfluous.
Just say no!
So what are we to do? Follow our duty to the community and the public, which is to produce as many results as possible? Or to follow our duty to ourselves and enjoy and understand what we are doing? To someone like me those things seem to be incorrigably opposed to each other now. At this pint the only option is to quit and find a new domain where human input in problem solving is still necessary.
In other words, it is a made-up argument. I think some mathematicians are either addicted (Feynman disease) or hope to make a breakthrough and somehow get credit. So they use "the public" to justify their habit.
The real public that is not on these forums wants academic freedom and independence from corporations. Both will suffer if you are entering soulless production pipelines.
I feel like same thing is happening to software. some people saying how they barely use AI, or how you can just do 10-100x more yet nobody seems to know where that demand will come from
Put out completed projects w.r.t products people are familiar with. E.g. show me that you can put out a scalable clone of IG...? Why don't these examples exist?
Like come on, I would LOVE to see that! The average person doesn't care about pet projects. Show something people are familiar with, and use on a regularly basis, that can be produced in a fraction of the resources.
Stop crying and start producing. The time to talk was five years ago. Everyone is way, way too tardy to the party.
It’s the same with developers: oh, but everything will collapse and nothing will work right without us manually signing off on this divinely ordained logic. Well, guess what? Nothing happened and things actually improved. Take a good hard look at software dev over the last ten years and tell me it was fine.
I am not at all convinced the current gen professionals are getting us to where we need to go.
No, I don't think calculators were associated with cheating. More with a skill atrophy.
Stockfish on the other hand is of course associated with cheating because it does all the work, unlike calculators.
Clearly not written by LLM. (NB: emphasis mine)