u/Tylerich

Hi, I have a theory about the direction of software engineering:

LLMs are pretty good at one shoting code, that doesn't exceed a certain complexity. Say functions, with a couple of tens of lines.

As complexity of a codebase grows, they become very crappy at writing code though, at least in my experience. (Even though people claim their gas been a performance jump since last December)

Doesn't that just mean that, the tasks of a software engineer have shifted to being more proficient at higher level architectural concepts?

Sure you can always say "but how long until that level is being automated away?". I think there might be hope though, that at least LLMs with the current architecture, won't get better at this.

Current thinking, models have become so good for small (and medium) tasks, because they have been trained via RL on tasks with verifiable rewards, so tasks where you have a clear yes or no answer if the code behaves correctly.

More complex software is not like that, since it can obviously be designed in an almost infinite amount of ways. Good judgment, genuine understanding of the architecture, and "taste" is way more important here. Currently I don't think any of the AI labs know how to develop models with these kind of skills.

What do you guys think about this? Maybe I am missing something? But wouldn't it be cool, if we could just learn to become more proficient at higher level ideas and continue to be valuable as programmers for a considerable amount of time to come?

Would really like to hear what you guys think!

What software do you use for transcribing music?

Do you know of any software with which I can record Spotify output, slow the recording down, add loops, and add filters to here notes more clearly?

I am actually developing an app like this, and would like to know if there would be interest in it, and what the closest software is that has these features...

Any hints and help are greatly appreciated! :)