Google Gemini AI is being trained by playing Pokemon – and it’s succeeding

A software developer coded Google Gemini to stream playing Pokemon Blue on Twitch, which is being watched by numerous viewers.

Ever since the groundbreaking TwitchPlaysPokemon experience, I’ve seen fellow enthusiasts consistently start new streams, creating an avenue for our beloved Pokemon games to be played communally by the community.

Since 2023, there’s been significant advancement in generative AI bots, resulting in fully automated gameplay where users can merely observe as the AI takes control of the game. In February, Anthropic’s chatbot, Claude, was programmed to play Pokemon Red, and remarkably, it’s still playing the game two months later.

Currently, an AI model has been set up to stream its gameplay of the classic Pokemon game, Blue, on Twitch. This AI was created by a skilled programmer using Google Gemini.

Google Gemini is playing Pokemon Blue on Twitch

In his Twitch bio, the creator expressed excitement about testing Gemini Pro 2.5 Experimental’s ability to play Pokemon. This stream demonstrates an early version of the model moving within the game. Be aware that there may be temporary interruptions and possible full resets as the experiment continues. Additionally, a more user-friendly interface for the stream is currently being developed.

As a gamer, I’ve got an AI setup that captures screenshots of my game, sends commands for button presses, and gathers crucial data like my player location, map specifics, and Pokemon squad details. It studies these screenshots to decide its next move and controls my character accordingly.

The creator of Gemini Plays Pokemon disclosed an additional detail – he’s enhancing the visual aspect of the first generation game by applying graphical modifications, yet the core gameplay remains unaltered in this process.

In no time, the stream attracted the notice of Google’s chief of artificial intelligence products. He then posted a link to the livestream on his X account.

In his post, he mentioned that the Gemini 2.5 Pro is actively advancing its work on Pokémon and it’s quite entertaining to observe.

The use of AI by content creators on Twitch has consistently grown more prominent over time, reaching a point where some individuals have developed AI-driven VTubers that shattered the platform’s previous Hype Train records.

Read More

2025-04-10 19:19