ChatGPT Code: Is the AI Actually Good At Writing Code? – IEEE Spectrum

July 24, 2024

I’ve been using GPT (3.5 then 4), Gemini, and some other models to produce Code for 18 months or more now. Other’s milage may vary but I’ve found it helps me be incredibly productive, in both languages I am very proficient in as well as other’s I’ve barely used.
My decades of experience as a developer certainly come in handy in identifying issues and resolving them–for now I certainly don’t think someone with little if any programming experience will be replacing experienced developers any time soon.

But this is anecdotal–the IEEE has published research looking to more objectively measure the quality and value of code produced by various large language models.