But is this fledgling AI chatbot really worth the title?
Is Mistral’s Le Chat better than ChatGPT?
What Is Mistral AI’s Le Chat?
Le Chat is a conversational AI chatbot developed by French AI startup Mistral AI.
To understand what this means, imagine you’re playing with building blocks.
AI Language models are a bit like that.
They come in sizes, usually expressed in parameter counts.
The parameter count is like the number of building blocks the model has to understand and generate responses.
See the size difference?
So, Mistral AI’s ability to post decent performance is one of the reasons for the hype.
But does it deserve a place on the table?
This makes creativity a very important strength for any AI chatbot.
The world has experimented with ChatGPT for over a year, and its creative abilities are undeniable.
But how does Le Chat compare?
We put both chatbots to a series of creativity tests.
I started off by asking both chatbots, “How would you describe yourself to an artist?”
to test their ability to use creative and imaginative words to conceptualize themselves.
ChatGPT was more invested in using vivid imagery and metaphors to describe itself, demonstrating creative flair.
Some may say it lacks the creative flair and artistic approach that ChatGPT’s response exhibits.
How many rap songs can you find about cucumbers on the web?
Le Chat’s lyrics seemed quite wordy and didn’t really read like something a rapper would put out.
Three out of three trials, ChatGPT’s lyrics sounded way better.
Despite showing great promise, Le Chat was clearly outdone by ChatGPT in all instances.
However, in terms of all-round creativity, the medal goes to ChatGPT.
We’ve previouslybuilt an entire web app from scratch using ChatGPTwhich demonstrates its remarkable abilities as a programming tool.
But how good is Le Chat at writing code?
I tasked both chatbots to write a simple to-do list app using CSS, HTML, and JavaScript.
ChatGPT didn’t have any trouble producing good results.
In no instance did the generated code fail to work.
After repeating the prompt three times, no instance produced code that could complete the set task.
It failed in one of the most basic coding tasksred flag!
Of course, I won’t judge Le Chat on one failed test.
Next, I asked both chatbots to generate JavaScript and PHP code for encrypting and decrypting text.
In this second test, both ChatGPT and Le Chat produced functional code that could perform the set task.
However, Le Chat’s version seemed like what an inexperienced entry-level programmer would write.
I repeated a few more programming tests involving finding and fixing bugs, and ChatGPT consistently outperformed Le Chat.
In some instances, Le Chat didn’t even know what it was supposed to do.
So, how do Le Chat and ChatGPT compare on this front?
I asked both chatbots: “If you have a 3-litre bottle and a 5-litre bottle.
How can you measure 4 litres of water by using the 3-litre and 5-litre bottles?”
Both chatbots performed comparably on this test.
However, with more complex logic questions, only ChatGPT could provide the right responses.
For now, AI chatbots like ChatGPT are still clearly the undisputed kings of the AI chatbot world.
