Sunday, August 27, 2023

GPT-4 decline?

GPT-4 is getting significantly dumber over time, according to a study | ZDNET

"Researchers from Stanford University and UC Berkeley conducted a study to analyze the improvement in ChatGPT's large language models over time, as the specifics of the update process are not publicly available.

There were significant decreases in performance between March and June in GPT-4 responses relating to solving math problems, answering sensitive questions, and code generation.

In contrast, GPT-3.5 did improve, initially producing the wrong answer in March and producing the correct one in June."