All that glitters in product presentations is not gold. Something that, on the other hand, does not surprise us. It turns out that what we saw at the launch of Gemini, Google’s new AI, was edited. And some of the data offered is very “optimistic.”
Gemini is Google’s new artificial intelligence, which supposedly surpasses OpenAI’s GPT-4. Google is betting on it to regain leadership in the AI market. You have more information in this card:
The great contribution of Gemini is that it is a single multimodal AI, which works at the same time with text, voice, images, videos, audio, code, etc. But don’t believe everything you saw in the presentation…
Gemini is not as fast and accurate as in the videos
Gemini is now available within Google Bard in some Anglo-Saxon countries, and only in English. It will soon arrive in other languages.
Google has uploaded some videos showing how Gemini workslike this:
We can see how Gemini instantly answers questions, or describes drawings as they are created.
But a Bloomberg investigation has found that the videos are doctored. Gemini is not as fast, nor is it much faster than GPT-4.
The video itself clarifies that “For the purposes of this demonstration, the latency has been reduced and the Gemini outputs have been shortened for brevity.” Come on, what the real Gemini runs slower.
According to Bloombergvia TechRadar, “the demo was not done in real time or with voice.” It appears that frames of still images from the filming and text prompts were used.
Therefore, Gemini does not respond with voice to actions in real time in the previous video, but only identifies still images. The presentation is a little misleading.
Google also talked about Germini outperforms GPT-4 in 30 of the 32 benchmarks usedbut according to Bloomberg it exceeds it by a very small percentage, in some cases negligible.
It seems that Gemini is on par with GPT-4, but does not improve it as much as Google claimed. Considering that GPT-4 is already eight months old, and GPT-5 is coming soon now that Sam Altman has regained control and OpenAI’s top priority is once again making money, Google will have to keep working to keep Gemini from left behind in a few months.
