Ethan Mollick: "Updated this chart with the newest Gemini. It shows the rapid progress in AI over less than two years: costs for GPT-4 class models has dropped 99.7% and even the most advanced models (beating PhDs at the GPQA) are still 82% cheaper than GPT-4. Probably not worth betting on this trend ending soon."

Post

Ethan Mollick

‪@emollick.bsky.social‬

Updated this chart with the newest Gemini. It shows the rapid progress in AI over less than two years: costs for GPT-4 class models has dropped 99.7% and even the most advanced models (beating PhDs at the GPQA) are still 82% cheaper than GPT-4. Probably not worth betting on this trend ending soon.

April 4, 2025 at 11:12 AM

14 reposts

3 quotes

59 likes

‪Ethan Mollick‬ ‪@emollick.bsky.social‬

All benchmarks are flawed but the the Graduate-Level Google-Proof Q&A test (GPQA) correlated well with other measures of performance. It is a series of very hard multiple-choice problems designed to test advanced knowledge. PhDs with access to the internet get around 81% right inside their specialty

‪whitemagicalhat.bsky.social‬ ‪@whitemagicalhat.bsky.social‬

And what does the progress projection look like factoring in Trump's tariffs on semiconductors from Taiwan? Taiwan, you know, the country where TSMC manufactures that chips that go into NVIDIA's GPUs?

‪Dr. Romain Fernandez‬ ‪@romainbioimage.bsky.social‬

Wow Gemini 2.5...