Skip to main content
GamesRadar+ GamesRadar+ GamesRadar+ The Games, Movies, TV & Comics You Love
Sign in
  • View Profile
  • Sign out
flag of UK
UK
flag of US
US
flag of Canada
Canada
flag of Australia
Australia
  • Games
  • TV
  • Movies
  • Hardware
  • Video
  • News
  • Reviews
  • Guides
  • Deals
  • More
    • PS5
    • Xbox Series X
    • Nintendo Switch
    • Nintendo Switch 2
    • PC
    • Platforms
    • Tabletop Gaming
    • Comics
    • Toys & Collectibles
    • SFX
    • Newsarama
    • Retro Gamer
    • Newsletters
    • About us
    • Features
Total Film
Gaming Magazines
Gaming Magazines
Why subscribe?
  • Subscribe from just £3
  • Takes you closer to the games, movies and TV you love
  • Try a single issue or save on a subscription
  • Issues delivered straight to your door or device
From$12
View
Trending
  • Summer Game Fest
  • New games for 2025
  • Upcoming Switch 2 games
  • Switch 2 stock

Recommended reading

No Man's Sky
Survival Games No Man's Sky boss assures fans Hello Games "did not have a secret room hiding deaf kids" following the survival game's unfortunately auto-captioned Switch 2 trailer
Quake 2 Copilot AI
FPS Games Microsoft's AI-powered Quake 2 demo makes me sick, not just because it's wrong on every level, but because I literally felt queasy playing it
The Witcher 4 screenshot with Ciri using sword and sorcery to fight an ancient monster
The Witcher The Witcher 4 first look - State of Unreal 2025 Live Coverage
Junker Queen - Overwatch 2
FPS Games Microsoft says the gaming AI it showed off in Overwatch 2 last week will only be added if devs don't think it's "unfair"
System Shock
Games "They pressed the AI button, it might have been a bad idea, but in truth there's no un-pressing that button," says Epic CEO, immediately after Epic shows a "conversation" with an AI that embarrasses us all
AI Limit
Action RPGs "AI is not as effective as it might appear": Dev of AI-focused Soulslike RPG says they didn't use any AI-generated content and it can't match "genuine creativity"
Tekken 8
Fighting Games Tekken lead Katsuhiro Harada says he's spent decades "mentally preparing" for AI to overtake humans, but it's not happening: "If AI had really advanced, we wouldn't be pouring 10, 20, 30 billion Yen into making games"
  1. Games

Microsoft's CaptionBot doesn't understand video games

Features
By Andy Hartup published 14 April 2016

When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.

Caption Contraption

Caption Contraption

This is Microsoft CaptionBot. It's a prototype tool (which ANYONE can visit, so go and give it a try) for labelling images. Apparently, CaptionBot can recognise any image and describe it "as well as any human". It's a truly astonishing piece of tech, and represents 1000s of hours of work by some of the smartest, most dedicated people on the planet. Naturally, then, the GamesRadar+ team immediately tried to use it for mischief...

As a team, we fed it a bunch of video game images to see what CaptionBot made of them. The results are shown over the next few pages, and they're all hilarious. We kinda feel bad laughing at such a smart, innovative piece of technology, but we can't help it. And the more we posted, the more under-confident CaptionBot seemed, making us feel rather like the playground bully, flushing the nerdy kid's head down the toilet and... oh my god, we're monsters. Ho hum. Take a look at what CaptionBot things about video games...

Page 1 of 14
Page 1 of 14
Crash Bandicoot

Crash Bandicoot

CaptionBot says: "I'm not really confident, but I think it's an orange vase"

We say: "See what you're trying to do there, CB, but no"

Page 2 of 14
Page 2 of 14
Destiny (Oryx)

Destiny (Oryx)

CaptionBot says: "I'm not really confident, but I think it's a glass display case"

We say: "Go home, CaptionBot, you're drunk"

Page 3 of 14
Page 3 of 14
Assassin's Creed

Assassin's Creed

CaptionBot says: "I'm not really confident, but I think it's a person wearing a hat"

We say: "Sure, close enough mate"

Page 4 of 14
Page 4 of 14
Dark Souls 3

Dark Souls 3

CaptionBot says: "I'm not really confident, but I think it's a close-up of an umbrella"

We say: "That's... not even close"

Page 5 of 14
Page 5 of 14
Far Cry Primal

Far Cry Primal

CaptionBot says: "I'm not really confident, but I think it's a man standing next to a cow and he seems :-|"

We say: "That's actually pretty good, CB. Loving the fact you recognised how sad he looks"

Page 6 of 14
Page 6 of 14
Mario and Luigi

Mario and Luigi

CaptionBot says: "I'm not really confident, but I think it's a woman getting ready to hit the ball"

We say: "Sure, Luigi has a feminine figure, but not sure what you're talking about when you say 'the ball'. Are you feeling ok?"

Page 7 of 14
Page 7 of 14
Silent Hill 2

Silent Hill 2

CaptionBot says: "I can't really describe the picture"

We say: "Yeah, fair play, it's pretty troubling. Hey, why are you curled up in a ball and rocking back and forth?"

Page 8 of 14
Page 8 of 14
Pokemon (Pikachu)

Pokemon (Pikachu)

CaptionBot says: "I'm not really confident, but I think that's a close up of two giraffes near a tree"

We say: "It... it is not"

Page 9 of 14
Page 9 of 14
Ratchet & Clank

Ratchet & Clank

CaptionBot says: "I'm not really confident, but I think it's a birthday cake"

We say: "If this was a birthday cake... it'd be incredible. Best birthday ever!"

Page 10 of 14
Page 10 of 14
Animal Crossing (Mr Resetti)

Animal Crossing (Mr Resetti)

CaptionBot says: "I'm not really confident, but I think it's a close-up of a toothbrush"

We say: "That would be the most terrifying toothbrush ever. And everyone in the world would probably agree that tooth decay is better than putting this near your mouth"

Page 11 of 14
Page 11 of 14
Sonic The Hedgehog

Sonic The Hedgehog

CaptionBot says: "I'm not really confident, but I think it's a person on a surfboard in a skate park"

We say: "Um..."

Page 12 of 14
Page 12 of 14
Street Fighter 5

Street Fighter 5

CaptionBot says: "I'm not really confident, but I think it's a person holding a hotdog"

We say: "Wildly inaccurate, although - to be fair - there is a hotdog stand in the background"

Page 13 of 14
Page 13 of 14
Uncharted 3

Uncharted 3

CaptionBot says: "I'm not really confident, but I think it's a man standing next to a fire and he seems :-|"

We say: "Correct. Also, you would be too, if you'd just escaped a plane crash"

Page 14 of 14
Page 14 of 14
CATEGORIES
PC Gaming Wii-u Nintendo PlayStation PS4 Xbox Xbox One Platforms
Andy Hartup
Andy Hartup
Social Links Navigation
See more Games Features
Read more
No Man's Sky
No Man's Sky boss assures fans Hello Games "did not have a secret room hiding deaf kids" following the survival game's unfortunately auto-captioned Switch 2 trailer
Quake 2 Copilot AI
Microsoft's AI-powered Quake 2 demo makes me sick, not just because it's wrong on every level, but because I literally felt queasy playing it
The Witcher 4 screenshot with Ciri using sword and sorcery to fight an ancient monster
The Witcher 4 first look - State of Unreal 2025 Live Coverage
Junker Queen - Overwatch 2
Microsoft says the gaming AI it showed off in Overwatch 2 last week will only be added if devs don't think it's "unfair"
System Shock
"They pressed the AI button, it might have been a bad idea, but in truth there's no un-pressing that button," says Epic CEO, immediately after Epic shows a "conversation" with an AI that embarrasses us all
AI Limit
"AI is not as effective as it might appear": Dev of AI-focused Soulslike RPG says they didn't use any AI-generated content and it can't match "genuine creativity"
Latest in Games
The Outer Worlds 2 screenshot showing a handgun being reloaded in the middle of combat
After playing The Outer Worlds 2, I'm convinced that it has the potential to be Obsidian's greatest game – and the best FPS of 2025
The Witcher 3 next-gen
"Suddenly a lot of people who loved Skyrim started paying attention to The Witcher 3": CDPR says an old E3 demo was a turning point for its defining RPG
Grounded 2 screenshot showing the entrance to the Ice Cream Truck chill area, with Summer Preview 2025 branding
Everything is bigger in Grounded 2, but Obsidian never considered stretching beyond four-player co-op: "It would have undermined what Grounded was really about"
Grave Seasons art showing a man with tied-back black hair wielding a hoe while a crow rests atop a fence nearby
This Stardew Valley-ish farming sim looks super cozy until you find out about the supernatural serial killer (who you can also romance)
The Witcher 4 cinematic screenshot showing a closeup of Ciri, protagonist of the new adventure
The Witcher 4's narrative lead is holding onto some of his earliest Witcher 3 feedback for the RPG's sequel: "We don't do fetch quests"
Grounded 2 screenshot with Summer Preview logo
After playing Grounded 2 for 30 minutes, it's clear that my favorite survival game is getting a massive glow-up
Latest in Features
The Outer Worlds 2 screenshot showing a handgun being reloaded in the middle of combat
After playing The Outer Worlds 2, I'm convinced that it has the potential to be Obsidian's greatest game – and the best FPS of 2025
Grounded 2 screenshot showing the entrance to the Ice Cream Truck chill area, with Summer Preview 2025 branding
Everything is bigger in Grounded 2, but Obsidian never considered stretching beyond four-player co-op: "It would have undermined what Grounded was really about"
Grounded 2 screenshot with Summer Preview logo
After playing Grounded 2 for 30 minutes, it's clear that my favorite survival game is getting a massive glow-up
Marco Ng as Alan in The Way We Talk
A new Hong Kong drama about three d/Deaf friends brings sign language to the big screen in a different way
Kill Team: Typhon box and card decks on a wooden table
Kill Team: Typhon introduces an unexpected twist to its competitive gameplay, and I think it might be a game-changer
End of Abyss Summer Preview
I played 30 minutes of the new game from the original Little Nightmares devs, and it turns out a twin-stick survival horror Metroidvania is a recipe for spooky heaven
  1. Nintendo Switch 2: Welcome Tour screenshot
    1
    Nintendo Switch 2 Welcome Tour review: "Mostly a fancy toy and not much more"
  2. 2
    MindsEye review: "An uninspired and forgettable sci-fi action adventure that feels like a Netflix movie you watch while on your phone"
  3. 3
    The Alters review: "More tactile and story-heavy than the Frostpunk dev's earlier games, but the fight for survival is just as fierce"
  4. 4
    Splitgate 2 review: "A slick and enjoyable free-to-play FPS, but a disappointing sequel"
  5. 5
    Date Everything review: "A masterclass in character design full of wonderful faces I love meeting, but juggling so many means sacrificing depth"
  1. The Yautja in Dan Trachtenberg's animated movie Predator: Killer of Killers
    1
    Predator: Killer of Killers review: "Great characters, thrilling action, and gorgeous Arcane-esque animation"
  2. 2
    From the World of John Wick: Ballerina review: "Brilliant action, even if the plot gives you a sense of déjà vu"
  3. 3
    Karate Kid: Legends review: "Better than Karate Kid (2010), nothing on Karate Kid (1984)"
  4. 4
    Mission: Impossible – The Final Reckoning review: "Wraps up this spy franchise in spectacular style with Tom Cruise in peak condition, even if its villain lacks terror"
  5. 5
    Final Destination Bloodlines Review: "Meticulous murderous mayhem"
  1. Rebecca Romijn as Una Chin-Riley / Number One and Anson Mount as Captain Christopher Pike in Star Trek: Strange New Worlds.
    1
    Star Trek: Strange New Worlds season 3 review: "The show's most assured run of episodes to date"
  2. 2
    Doctor Who season 2, episode 8 spoiler review: 'The Reality War' is "a mix of the good, the bad, and the truly baffling"
  3. 3
    Doctor Who season 2, episode 7 spoiler review: 'Wish World' is "an exciting and ambitious" start to the season finale, with hints of WandaVision
  4. 4
    Rick and Morty season 8 review: "Largely plays it too safe after years of crossing boundaries"
  5. 5
    Doctor Who season 2, episode 6 spoiler review: 'The Interstellar Song Contest' is "a blast and sets the stage for a thrilling season finale"

GamesRadar+ is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.

  • About Us
  • Contact Future's experts
  • Terms and conditions
  • Privacy policy
  • Cookies policy
  • Advertise with us
  • Review guidelines
  • Write for us
  • Accessibility Statement
  • Careers

© Future US, Inc. Full 7th Floor, 130 West 42nd Street, New York, NY 10036.

Please login or signup to comment

Please wait...