Post by account_disabled on Feb 22, 2024 0:35:55 GMT -5
Google just announced Gemini, its most powerful suite of AI models yet, and the company has already been accused of lying about its performance. A Bloomberg op-ed claims that Google misrepresented the power of Gemini in a recent video. Google aired an impressive “what the hell” hands-on video during its announcement earlier this week, and columnist Parmy Olson says she seemed remarkably capable in the video — maybe capable, too . The six-minute video showcases Gemini's multimodal capabilities (spoken conversation prompts combined with image recognition, for example). Gemini apparently recognizes images quickly, even for connect-the-dots images, responds in seconds, and tracks a wad of paper in a real-time game of cup and ball.
Sure, humans can do all that, but this is an AI Luxembourg Mobile Number List capable of recognizing and predicting what will happen next. But click on the video description on YouTube and Google will have an important disclaimer: "For the purposes of this demonstration, latency has been reduced and Gemini outputs have been shortened for brevity." That's what bothers Olson. According to her Bloomberg piece , when asked for comment, Google admitted that the video demonstration did not occur in real time with spoken prompts, but instead used still frames of raw images and then typed text prompts to which Gemini responded.
That's quite different from what Google seemed to suggest: that a person could have a fluid voice conversation with Gemini while it observes and responds in real time to the world around it," Olson writes. To be fair to Google, companies edit demo videos frequently, especially because many want to avoid the technical issues that come with live demos. It is common to modify things a little. But Google has a history of questionable video demonstrations. People wondered if Google's Duplex demo (remember Duplex, the AI voice assistant that called hair salons and restaurants to make reservations?) was real because there was a distinct lack of ambient noise and overly helpful employees.