> In particular, GPT-2 to GPT-4 spans an increase from 'well read toddler' to 'average high school student'

GPT-2 was indeed much smaller and weaker model. But the question do we have "exponential" boost after GPT3, or just marginal while competition commoditized this vertical.