Test 1 - summarising text

This page has 0 threads | Add post

Blogs

Finding our blogs useful? Please consider helping us to share more!

Comparing 5 of the main AI tools again 12 months on Part two of a seven-part series of blogs
In July 2024 I wrote a long blog comparing the 4 main AI tools, and added DeepSeek to the comparison in February 2025. The AI world is moving so quickly that I thought I'd redo the tests to see if they yielded the same results. Comparing 5 of the main AI tools again 12 months on Test 1 - summarising text (this blog) Test 2 - coding Test 3 - presenting arguments Test 4 - creating images Test 5 - creativity and role-playing Conclusions and recommedations

Comparing 5 of the main AI tools again 12 months on

Part two of a seven-part series of blogs

In July 2024 I wrote a long blog comparing the 4 main AI tools, and added DeepSeek to the comparison in February 2025. The AI world is moving so quickly that I thought I'd redo the tests to see if they yielded the same results.

Comparing 5 of the main AI tools again 12 months on
Test 1 - summarising text (this blog)
Test 2 - coding
Test 3 - presenting arguments
Test 4 - creating images
Test 5 - creativity and role-playing
Conclusions and recommedations

Posted by Andy Brown on 05 June 2025

Our first test is to ask this prompt:

You are an experienced book reviewer. You write concisely and without jargon or filler words. Create a table listing out the main characters in Pride and Prejudice by Jane Austen with these 2 columns: “Character name”, “Summary of personality”. You should limit the description of each character’s personality to no more than 30 words. Present the list of characters in order of importance (so with the most important character first), then underneath the table finish by explaining which character you like best, and why.

Here's how the different tools got on. I've chosen to list the character description of Jane Bennett at random for each AI tool, to keep this table short, along with each AI tool's justification for choosing their favourite character (inevitably Elizabeth Bennet in each case):

Tool	Number of characters listed	Example - Jane Bennet	Favourite character
ChatGPT	11	Gentle, kind, and optimistic; always sees the best in others.	Elizabeth Bennet . She's sharp, self-aware, and grows throughout the novel. Her independence and willingness to admit fault make her both believable and admirable.
Claude	12	Gentle, kind-hearted, and modest eldest sister who sees good in everyone. Reserved in expressing emotions, sometimes to her detriment.	Elizabeth Bennet She embodies the novel's central theme of overcoming prejudice through self-awareness. Her journey from quick judgment to deeper understanding feels authentic, and her refusal to compromise her principles for social advancement makes her a compelling heroine. Elizabeth's wit and intelligence drive both the plot and the novel's social commentary, making her indispensable to Austen's critique of Georgian society.
Copilot	10	Gentle, kind, beautiful and optimistic. Always sees the best in others.	Elizabeth Bennet is the most compelling. She is sharp, perceptive, and unapologetically independent. Her character grows throughout the novel as she learns to balance judgment with understanding. She's a true literary icon.
Gemini	13	Gentle, kind-hearted, and optimistic. Tends to see the good in everyone, sometimes to a fault.	I like Elizabeth Bennet best. Her spirited independence and sharp wit, combined with her capacity for self-reflection and growth, make her a truly engaging and admirable character.

Notwithstanding Claude's inability to count (it uses 58 words to describe Elizabeth Bennet, whereas I stipulated a maximum of 30) I think it just edges this test, although all of the results are very similar.

Parts of this blog
Comparing 5 of the main AI tools again 12 months on Test 1 - summarising text (this blog) Test 2 - coding Test 3 - presenting arguments Test 4 - creating images Test 5 - creativity and role-playing Conclusions and recommedations

Some other pages relevant to the above blogs include:

Learn Artificial Intelligence

This blog has 0 threads

Add a new post

ALL BLOGS

ARTIFICIAL INTELLIGENCE BLOGS

ARTIFICIAL INTELLIGENCE (AI) BLOGS

Head office

London

Manchester