Test 2 - coding

This page has 0 threads | Add post

Blogs

Finding our blogs useful? Please consider helping us to share more!

Comparing 5 of the main AI tools again 12 months on Part three of a seven-part series of blogs
In July 2024 I wrote a long blog comparing the 4 main AI tools, and added DeepSeek to the comparison in February 2025. The AI world is moving so quickly that I thought I'd redo the tests to see if they yielded the same results. Comparing 5 of the main AI tools again 12 months on Test 1 - summarising text Test 2 - coding (this blog) Test 3 - presenting arguments Test 4 - creating images Test 5 - creativity and role-playing Conclusions and recommedations

Comparing 5 of the main AI tools again 12 months on

Part three of a seven-part series of blogs

In July 2024 I wrote a long blog comparing the 4 main AI tools, and added DeepSeek to the comparison in February 2025. The AI world is moving so quickly that I thought I'd redo the tests to see if they yielded the same results.

Comparing 5 of the main AI tools again 12 months on
Test 1 - summarising text
Test 2 - coding (this blog)
Test 3 - presenting arguments
Test 4 - creating images
Test 5 - creativity and role-playing
Conclusions and recommedations

Posted by Andy Brown on 05 June 2025

In this blog

ChatGPT's answer
Claude's answer
Copilot's answer
Gemini's answer
Conclusion

Here's what I asked each AI tool for this test:

You want to write a program to sort the names of the 7 dwarves (from Snow White and the Seven Dwarves) into random order, and output the names as a comma-delimited list. Every time you run the program it should present the dwarves in a different order. Please create 3 versions of the program (one for Python, one for Visual C# and one for VBA), then conclude by saying which one you think is the best way to solve this problem, and why.

I'm most interested in what the different tools will answer to the last question (it's a subjective question, and I'm hoping for subjective answers)..

ChatGPT's answer

I liked both this answer and the choice for favourite language:

It's hard to disagree with the conclusion!

Claude's answer

Claude's answer is nearly identical to that provided by ChatGPT:

It's hard to believe this answer came from a completely different large language model.

Copilot's answer

Copilot's response to this prompt is also pretty similar!

I like the summary of the 3 options, which is less dismissive of C# and VBA than the other two answers.

Gemini's answer

Gemini gave by far the longest answer, choosing to give much more explanation for each program. Because it's answer was so long I've only reproduced the VBA program below:

Gemini wins points for mentioning LINQ, but then loses them because I don't think this is supported in VBA (just VB).

Conclusion

It's almost impossible to choose between the different answers, which are basically the same in each case.

Parts of this blog
Comparing 5 of the main AI tools again 12 months on Test 1 - summarising text Test 2 - coding (this blog) Test 3 - presenting arguments Test 4 - creating images Test 5 - creativity and role-playing Conclusions and recommedations