Beyond mirroring the engineering practices that you yourself want to see other people perform, have you found any techniques to get people to … in short, do their job again? Understand context, understand what they did, why they did it, what they’re doing, etc.
The +/-2000 line MR was bad when humans wrote it. It’s way worse when the human didn’t even write or read it.
And just vomiting automated CodeRabbit talking points back and forth at each other feels equally harmful.
Are we really tolerating turning ourselves into LLM rubber stamps?
For me the trick was just leaning all the way into it. I had a residual idea that if someone sends me a 2000 line PR, 10 page design, etc., that this represents some concrete investment of time and effort that deserves my careful consideration. And it just doesn't anymore.
I have one project where there must be hundreds of pages of design proposals I have not read and will never read, because the author really likes having Claude generate complete design proposals based on incomplete understanding. So every week or two he sends me a new one, I spend 30 seconds skimming it, and then I tab back to Slack to ask him to explain.
I don't like working this way, but you know, I don't like doing rollouts either. It's certainly better than being a human rubberstamp.
Typically what happens is that we have a good conversation, we make progress towards figuring out what they should want to do and how they should try to do it, and the 2000 line PR or 10 page doc gets abandoned. I do read things in detail when I expect I might one day be convinced to approve them, but that fraction has plummeted from 95% to like 20% since January.
Have you noticed an increase in their willingness to “do the right thing first time” during these last 6 months since your approval rate has dropped that much? (Even if the right thing is to have more conversations)?
Do you know if there’s a way to incentivize them to lean toward doing the right thing first? Are the company and stakeholder goals and objectives in line with them making progress toward higher quality engineering? That is, are these juniors protected from randoms asking them to circumvent good process, etc?
Unfortunately, I've had a number of people explicitly defend that nothing's going wrong here. Their view is that, if sloppy code is cheap, everyone might as well produce some to illustrate their ideas before having a conversation. I'm skeptical of that position but haven't had much luck in fighting it.
> Are the company and stakeholder goals and objectives in line with them making progress toward higher quality engineering? That is, are these juniors protected from randoms asking them to circumvent good process, etc?
In my personal experience yes, but I've seen a few teams and heard stories of many more where the juniors are not protected and they just ship regressions and outages all the time now. I think the trend towards AI cost controls will mitigate this, although the impact will of course be uneven as companies behind the curve discover powerful agentic coding for the first time.
The +/-2000 line MR was bad when humans wrote it. It’s way worse when the human didn’t even write or read it.
And just vomiting automated CodeRabbit talking points back and forth at each other feels equally harmful.
Are we really tolerating turning ourselves into LLM rubber stamps?