You can now pay $200/month for ChatGPT Pro. But is it worth it? How does it compare to other models?

Let’s look at a four-way model comparison and find out…

The first two models we’ll look at will be ChatGPT Pro and Gemini Advanced. Jason Calacanis and Sunny Madra tested those on an excellent new episode of This Week in Startups.

Next, I’m going to take the same prompt they used and feed it to Grok and Claude.

Let’s see who wins!

ChatGPT Pro

Jason did not make it easy on OpenAI. He asked for a detailed model on what it would cost to build a robotaxi fleet to replace all car trips.

This model requires a ton of research and calculations. It might take a skilled human an entire day.

Let’s see how ChatGPT Pro does…

O1 gave a detailed analysis nicely broken up into tables. But o1-pro, the $200 version, was more detailed and included great links to sources.

O1 pro answered every element of this very complex question well. It really does excel at deep analysis.

O1 pro was better than o1, but not by much. If you’re price sensitive, o1 is the better choice at just $20/month. But for major businesses, o1 pro makes sense.

Next, Jason and Sunny tried Gemini…

Gemini Advanced

Gemini really crushed it here. The new Gemini Advanced 1.5 Pro with Deep Research may be a mouthful, but it’s also a heck of a model.

Gemini accounted for bus trips and flights that could be replaced by robotaxis. It also calculated the maintenance costs for the robotaxis, something all the other models ignored.

The answer is clear, exhaustive, and contains lots of sources. Jason and Sunny were really impressed, and so am I.

Can Elon do even better? Next, I tried my recent favorite, Grok…

Grok

Grok just gave up. It said it couldn’t conduct such a detailed analysis using outside sources.

I actually respect that. Instead of giving us a wrong answer, it just declined the question. That’s a lot better than making something up!

I find that Grok is great for most questions. But for super detailed data analysis, other models are stronger.

Claude

Finally, I fed the same prompt to Claude. I’ve always had great luck with Claude for detailed data analysis tasks.

I used Claude’s most advanced model, 3.5 Sonnet. Let’s see how it does…

Claude got the replacement cost of normal Uber/Lyft rides with robotaxi rides correct. But it skipped the part of the question about replacing the entire US auto fleet.

So, Claude gave only an incomplete answer to the question. O1 pro was better, and Gemini beat them both.

Wrap-Up

In the world of AI models, more expensive doesn’t necessarily mean better.

Google’s $20/month tool outperformed the $200/month ChatGPT Pro, along with everything else we tested. For hardcore analysis, nothing beats Gemini.

I’m going to upgrade to Gemini’s paid tier and keep playing around with this incredible tool. I’ll let you guys know what I find out!

What’s your favorite AI model, and why?

More on tech:

ChatGPT vs. Grok: Head-to-Head Comparison

ChatGPT Search vs. Google: Which Should You Use?

How to Get Started Angel Investing

Save Money on Stuff I Use:

Fundrise

This platform lets me diversify my real estate investments so I’m not too exposed to any one market. I’ve invested since 2018 with great returns.

More on Fundrise in this post.

If you decide to invest in Fundrise, you can use this link to get $100 in free bonus shares!

Misfits Market

I’ve used Misfits for years, and it never disappoints! Every fruit and vegetable is organic, super fresh, and packed with flavor!

I wrote a detailed review of Misfits here.

Use this link to sign up and you’ll save $15 on your first order.