Has anyone compared Google's new Codey, Code Whisperer, and GPT-4 for code generation?
For my service to work at all, I feel like I really need GPT-4 or something better if that ever comes along.
But aside from GPT-4 trying to use APIs from two years ago, it can definitely make simple software without necessarily needing an actual programmer. Especially when you put it in a closed loop.
As the models get better with larger context windows and more up-to-date training, software engineers will probably defer more and more to the AI. And non-programmers will be able to build software with it also.
The time where this is just minor code completion or something is going to be pretty limited. In 3-5 years, I would be very surprised it was considered good software engineering to have humans writing code at all.
I find that GPT-4 always wins in task specific, clear prompts.
E.g. I used it on a project recently to translate code from one version to another, and keep in mind that the syntax was very different
A comparable example would be translating old class based React code to functional TSX with hooks.
And it does extremely well there. Other coding tools can’t even do that as there’s no way to load a whole prompt and the entire original file as a prompt.
For my service to work at all, I feel like I really need GPT-4 or something better if that ever comes along.
But aside from GPT-4 trying to use APIs from two years ago, it can definitely make simple software without necessarily needing an actual programmer. Especially when you put it in a closed loop.
As the models get better with larger context windows and more up-to-date training, software engineers will probably defer more and more to the AI. And non-programmers will be able to build software with it also.
The time where this is just minor code completion or something is going to be pretty limited. In 3-5 years, I would be very surprised it was considered good software engineering to have humans writing code at all.