Skip to main content
GamesRadar+ GamesRadar+ GamesRadar+ The Games, Movies, TV & Comics You Love
Sign in
  • View Profile
  • Sign out
flag of UK
UK
flag of US
US
flag of Canada
Canada
flag of Australia
Australia
  • Games
  • TV
  • Movies
  • Hardware
  • Video
  • News
  • Reviews
  • Guides
  • Deals
  • More
    • PS5
    • Xbox Series X
    • Nintendo Switch
    • Nintendo Switch 2
    • PC
    • Platforms
    • Tabletop Gaming
    • Comics
    • Toys & Collectibles
    • SFX
    • Newsarama
    • Retro Gamer
    • Newsletters
    • About us
    • Features
Total Film
Gaming Magazines
Gaming Magazines
Why subscribe?
  • Subscribe from just £3
  • Takes you closer to the games, movies and TV you love
  • Try a single issue or save on a subscription
  • Issues delivered straight to your door or device
From$12
View
Trending
  • Prime Day Deals
  • Superman
  • Donkey Kong Bananza
  • Switch 2 stock
Recommended reading
No Man's Sky
Survival Games No Man's Sky boss assures fans Hello Games "did not have a secret room hiding deaf kids" following the survival game's unfortunately auto-captioned Switch 2 trailer
The Witcher 4 screenshot with Ciri using sword and sorcery to fight an ancient monster
The Witcher The Witcher 4 first look - State of Unreal 2025 Live Coverage
System Shock
Games "They pressed the AI button, it might have been a bad idea, but in truth there's no un-pressing that button," says Epic CEO, immediately after Epic shows a "conversation" with an AI that embarrasses us all
Ben Starr presenting at the BAFTA Game Awards in clown attire
Roguelike Games "LocalThunk is really rich now": 2 weeks after winning yet another GOTY award, Balatro sends Final Fantasy 16 star to accept award in "suspiciously arousing" Jimbo attire
Xbox - Future Owns
Games Xbox is hiring to "secure the future of game preservation," and this time it's no AI Quake nightmare
Photo of the new Xbox handheld, the ROG Xbox Ally X
Hardware "Pick your lane and stick to it": Former Blizzard president says it's "tough to see Xbox confused" amid "this is an Xbox" branding: "They have to figure out what needs to change... and fast"
Halo Infinite
Games Xbox executive producer offers "best advice I can" to those caught up in Microsoft's latest lay-off spree – AI prompts to "help reduce the emotional and cognitive load that comes with job loss"
  1. Games

Microsoft's CaptionBot doesn't understand video games

Features
By Andy Hartup published 14 April 2016

When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.

Caption Contraption

Caption Contraption

This is Microsoft CaptionBot. It's a prototype tool (which ANYONE can visit, so go and give it a try) for labelling images. Apparently, CaptionBot can recognise any image and describe it "as well as any human". It's a truly astonishing piece of tech, and represents 1000s of hours of work by some of the smartest, most dedicated people on the planet. Naturally, then, the GamesRadar+ team immediately tried to use it for mischief...

As a team, we fed it a bunch of video game images to see what CaptionBot made of them. The results are shown over the next few pages, and they're all hilarious. We kinda feel bad laughing at such a smart, innovative piece of technology, but we can't help it. And the more we posted, the more under-confident CaptionBot seemed, making us feel rather like the playground bully, flushing the nerdy kid's head down the toilet and... oh my god, we're monsters. Ho hum. Take a look at what CaptionBot things about video games...

Page 1 of 14
Page 1 of 14
Crash Bandicoot

Crash Bandicoot

CaptionBot says: "I'm not really confident, but I think it's an orange vase"

We say: "See what you're trying to do there, CB, but no"

Page 2 of 14
Page 2 of 14
Destiny (Oryx)

Destiny (Oryx)

CaptionBot says: "I'm not really confident, but I think it's a glass display case"

We say: "Go home, CaptionBot, you're drunk"

Page 3 of 14
Page 3 of 14
Assassin's Creed

Assassin's Creed

CaptionBot says: "I'm not really confident, but I think it's a person wearing a hat"

We say: "Sure, close enough mate"

Page 4 of 14
Page 4 of 14
Dark Souls 3

Dark Souls 3

CaptionBot says: "I'm not really confident, but I think it's a close-up of an umbrella"

We say: "That's... not even close"

Page 5 of 14
Page 5 of 14
Far Cry Primal

Far Cry Primal

CaptionBot says: "I'm not really confident, but I think it's a man standing next to a cow and he seems :-|"

We say: "That's actually pretty good, CB. Loving the fact you recognised how sad he looks"

Page 6 of 14
Page 6 of 14
Mario and Luigi

Mario and Luigi

CaptionBot says: "I'm not really confident, but I think it's a woman getting ready to hit the ball"

We say: "Sure, Luigi has a feminine figure, but not sure what you're talking about when you say 'the ball'. Are you feeling ok?"

Page 7 of 14
Page 7 of 14
Silent Hill 2

Silent Hill 2

CaptionBot says: "I can't really describe the picture"

We say: "Yeah, fair play, it's pretty troubling. Hey, why are you curled up in a ball and rocking back and forth?"

Page 8 of 14
Page 8 of 14
Pokemon (Pikachu)

Pokemon (Pikachu)

CaptionBot says: "I'm not really confident, but I think that's a close up of two giraffes near a tree"

We say: "It... it is not"

Page 9 of 14
Page 9 of 14
Ratchet & Clank

Ratchet & Clank

CaptionBot says: "I'm not really confident, but I think it's a birthday cake"

We say: "If this was a birthday cake... it'd be incredible. Best birthday ever!"

Page 10 of 14
Page 10 of 14
Animal Crossing (Mr Resetti)

Animal Crossing (Mr Resetti)

CaptionBot says: "I'm not really confident, but I think it's a close-up of a toothbrush"

We say: "That would be the most terrifying toothbrush ever. And everyone in the world would probably agree that tooth decay is better than putting this near your mouth"

Page 11 of 14
Page 11 of 14
Sonic The Hedgehog

Sonic The Hedgehog

CaptionBot says: "I'm not really confident, but I think it's a person on a surfboard in a skate park"

We say: "Um..."

Page 12 of 14
Page 12 of 14
Street Fighter 5

Street Fighter 5

CaptionBot says: "I'm not really confident, but I think it's a person holding a hotdog"

We say: "Wildly inaccurate, although - to be fair - there is a hotdog stand in the background"

Page 13 of 14
Page 13 of 14
Uncharted 3

Uncharted 3

CaptionBot says: "I'm not really confident, but I think it's a man standing next to a fire and he seems :-|"

We say: "Correct. Also, you would be too, if you'd just escaped a plane crash"

Page 14 of 14
Page 14 of 14
CATEGORIES
PC Gaming Wii-u Nintendo PlayStation PS4 Xbox Xbox One Platforms
Andy Hartup
Andy Hartup
Social Links Navigation
See more Games Features
Read more
No Man's Sky
No Man's Sky boss assures fans Hello Games "did not have a secret room hiding deaf kids" following the survival game's unfortunately auto-captioned Switch 2 trailer
The Witcher 4 screenshot with Ciri using sword and sorcery to fight an ancient monster
The Witcher 4 first look - State of Unreal 2025 Live Coverage
System Shock
"They pressed the AI button, it might have been a bad idea, but in truth there's no un-pressing that button," says Epic CEO, immediately after Epic shows a "conversation" with an AI that embarrasses us all
Ben Starr presenting at the BAFTA Game Awards in clown attire
"LocalThunk is really rich now": 2 weeks after winning yet another GOTY award, Balatro sends Final Fantasy 16 star to accept award in "suspiciously arousing" Jimbo attire
Xbox - Future Owns
Xbox is hiring to "secure the future of game preservation," and this time it's no AI Quake nightmare
Photo of the new Xbox handheld, the ROG Xbox Ally X
"Pick your lane and stick to it": Former Blizzard president says it's "tough to see Xbox confused" amid "this is an Xbox" branding: "They have to figure out what needs to change... and fast"
Latest in Games
Ahoy
$700,000 in Kickstarter booty says Sid Meier's Pirates! sickos are fully on board with this first-person, open world, and "most importantly - authentic" take on nautical history that's lacking in Sea of Thieves and Black Flag
Team Fortress 2 soldier holding two grenades
Valve "cracked the problem that Netflix was struggling with" using diehard gamers and their backlogs, Steam expert says: "You get access to a bunch of drunken sailors who spend money irresponsibly"
Sigil 2 cover art of horned goat demon
"Romero Games is not closed": After reports of layoffs caused by Microsoft, Romero Games says it did lose funding but has now heard from "several publishers interested in helping us"
Concord
EU publisher group addresses Stop Killing Games movement in early double down: killing online games "must be an option," and this proposal would make them "prohibitively expensive to create"
Monster Hunter Wilds
With Monster Hunter Wilds "Overwhelmingly Negative" in recent Steam reviews due to optimization, Capcom cancels panel on "everything you need to know about optimization" following statement on dev harassment
Subnautica 2
Subnautica studio co-founder speaks on "shock" dismissal, says "we know that the game is ready" – "To find that I'm no longer able to work at the company I started stings"
Latest in Features
Kaizen: A Factory Story key art featuring a production line making a toy electronic
"Make games and die. That's my plan": Coincidence's Zach Barth on making games about making things, a year of teaching, and being in it for the long haul
Cyberpunk Edgerunners
Cyberpunk Edgerunners season 2: Everything we know about CD Projekt Red's anime
David Corenswet, Rachel Brosnahan, and Skyler Gisondo in Superman
Do I need to watch any movies or TV shows before Superman?
David Corenswet as Superman in James Gunn's Superman
James Gunn's Superman looks like a comics-accurate take on the Man of Steel at last – but will it be enough to revive DC at the box office?
A cropped screenshot from Undertale, showing Frisk and Sans standing in Grillby's in Snowdin.
17 years after it was released, I'm tracing Undertale and Deltarune's origins back to Toby Fox's spooky Earthbound mod
Superman movies ranked: Christopher Reeve as Superman flying through the sky during the 1978 movie Superman.
All the Superman movies ranked from worst to best, ahead of James Gunn's upcoming DC movie
  1. A Gundam style mech in Mecha Break
    1
    Mecha Break review: "This mech battler makes up for lacking customization with a varied roster that lets me live out my Evangelion fantasy"
  2. 2
    Death Stranding 2: On the Beach review: "This tarpunk delivery epic is more Metal Gear Solid than ever, for better and worse"
  3. 3
    Rematch review: "As with Rocket League, the just-one-more-game pull is magnetic"
  4. 4
    Tron: Catalyst review: "Disc slinging is a thrill in this gorgeous rendition of the series, but I'm let down by a time-loop story that falls flat"
  5. 5
    FBC: Firebreak review: "A disappointingly bland multiplayer FPS that's missing far too much of what made Control special"
  1. A T-rex in Jurassic World Rebirth
    1
    Jurassic World Rebirth Review: "An unscary sequel that needed a little more time in amber"
  2. 2
    M3GAN 2.0 review: "A bold sequel with a slightly underwhelming conclusion"
  3. 3
    28 Years Later Review: "Enough terror, splatter and suspense to satisfy”
  4. 4
    Predator: Killer of Killers review: "Great characters, thrilling action, and gorgeous Arcane-esque animation"
  5. 5
    From the World of John Wick: Ballerina review: "Brilliant action, even if the plot gives you a sense of déjà vu"
  1. Lee Jung-jae as Gi-hun in Squid Game season 3
    1
    Squid Game season 3 review: "A staggeringly excellent final season wraps up one of the greatest Netflix shows ever"
  2. 2
    Ironheart review: "A relic of Marvel's content-at-all-costs era"
  3. 3
    Star Trek: Strange New Worlds season 3 review: "The show's most assured run of episodes to date"
  4. 4
    Doctor Who season 2, episode 8 spoiler review: 'The Reality War' is "a mix of the good, the bad, and the truly baffling"
  5. 5
    Doctor Who season 2, episode 7 spoiler review: 'Wish World' is "an exciting and ambitious" start to the season finale, with hints of WandaVision

GamesRadar+ is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.

  • About Us
  • Contact Future's experts
  • Terms and conditions
  • Privacy policy
  • Cookies policy
  • Advertise with us
  • Review guidelines
  • Write for us
  • Accessibility Statement
  • Careers

© Future US, Inc. Full 7th Floor, 130 West 42nd Street, New York, NY 10036.

Please login or signup to comment

Please wait...