Skip to main content
GamesRadar+ GamesRadar+ GamesRadar+ The Games, Movies, TV & Comics You Love
Sign in
  • View Profile
  • Sign out
flag of UK
UK
flag of US
US
flag of Canada
Canada
flag of Australia
Australia
  • Games
  • TV
  • Movies
  • Hardware
  • Video
  • News
  • Reviews
  • Guides
  • Deals
  • More
    • PS5
    • Xbox Series X
    • Nintendo Switch
    • Nintendo Switch 2
    • PC
    • Platforms
    • Tabletop Gaming
    • Comics
    • Toys & Collectibles
    • SFX
    • Newsarama
    • Retro Gamer
    • Newsletters
    • About us
    • Features
Total Film
Gaming Magazines
Gaming Magazines
Why subscribe?
  • Subscribe from just £3
  • Takes you closer to the games, movies and TV you love
  • Try a single issue or save on a subscription
  • Issues delivered straight to your door or device
From$12
View
Trending
  • Prime Day Deals
  • Superman
  • Donkey Kong Bananza
  • Switch 2 stock
Recommended reading
No Man's Sky
Survival Games No Man's Sky boss assures fans Hello Games "did not have a secret room hiding deaf kids" following the survival game's unfortunately auto-captioned Switch 2 trailer
The Witcher 4 screenshot with Ciri using sword and sorcery to fight an ancient monster
The Witcher The Witcher 4 first look - State of Unreal 2025 Live Coverage
System Shock
Games "They pressed the AI button, it might have been a bad idea, but in truth there's no un-pressing that button," says Epic CEO, immediately after Epic shows a "conversation" with an AI that embarrasses us all
Xbox Gamescom 2023 logo featuring a stylized city skyline in green
Xbox "What happened with Microsoft was clear": Former Square Enix exec says Game Pass, "a service with barely any growth," didn't cause layoffs – competition with AI did
Xbox - Future Owns
Games Xbox is hiring to "secure the future of game preservation," and this time it's no AI Quake nightmare
Photo of the new Xbox handheld, the ROG Xbox Ally X
Hardware "Pick your lane and stick to it": Former Blizzard president says it's "tough to see Xbox confused" amid "this is an Xbox" branding: "They have to figure out what needs to change... and fast"
Halo Infinite
Games Xbox executive producer offers "best advice I can" to those caught up in Microsoft's latest lay-off spree – AI prompts to "help reduce the emotional and cognitive load that comes with job loss"
  1. Games

Microsoft's CaptionBot doesn't understand video games

Features
By Andy Hartup published 14 April 2016

When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.

Caption Contraption

Caption Contraption

This is Microsoft CaptionBot. It's a prototype tool (which ANYONE can visit, so go and give it a try) for labelling images. Apparently, CaptionBot can recognise any image and describe it "as well as any human". It's a truly astonishing piece of tech, and represents 1000s of hours of work by some of the smartest, most dedicated people on the planet. Naturally, then, the GamesRadar+ team immediately tried to use it for mischief...

As a team, we fed it a bunch of video game images to see what CaptionBot made of them. The results are shown over the next few pages, and they're all hilarious. We kinda feel bad laughing at such a smart, innovative piece of technology, but we can't help it. And the more we posted, the more under-confident CaptionBot seemed, making us feel rather like the playground bully, flushing the nerdy kid's head down the toilet and... oh my god, we're monsters. Ho hum. Take a look at what CaptionBot things about video games...

Page 1 of 14
Page 1 of 14
Crash Bandicoot

Crash Bandicoot

CaptionBot says: "I'm not really confident, but I think it's an orange vase"

We say: "See what you're trying to do there, CB, but no"

Page 2 of 14
Page 2 of 14
Destiny (Oryx)

Destiny (Oryx)

CaptionBot says: "I'm not really confident, but I think it's a glass display case"

We say: "Go home, CaptionBot, you're drunk"

Page 3 of 14
Page 3 of 14
Assassin's Creed

Assassin's Creed

CaptionBot says: "I'm not really confident, but I think it's a person wearing a hat"

We say: "Sure, close enough mate"

Page 4 of 14
Page 4 of 14
Dark Souls 3

Dark Souls 3

CaptionBot says: "I'm not really confident, but I think it's a close-up of an umbrella"

We say: "That's... not even close"

Page 5 of 14
Page 5 of 14
Far Cry Primal

Far Cry Primal

CaptionBot says: "I'm not really confident, but I think it's a man standing next to a cow and he seems :-|"

We say: "That's actually pretty good, CB. Loving the fact you recognised how sad he looks"

Page 6 of 14
Page 6 of 14
Mario and Luigi

Mario and Luigi

CaptionBot says: "I'm not really confident, but I think it's a woman getting ready to hit the ball"

We say: "Sure, Luigi has a feminine figure, but not sure what you're talking about when you say 'the ball'. Are you feeling ok?"

Page 7 of 14
Page 7 of 14
Silent Hill 2

Silent Hill 2

CaptionBot says: "I can't really describe the picture"

We say: "Yeah, fair play, it's pretty troubling. Hey, why are you curled up in a ball and rocking back and forth?"

Page 8 of 14
Page 8 of 14
Pokemon (Pikachu)

Pokemon (Pikachu)

CaptionBot says: "I'm not really confident, but I think that's a close up of two giraffes near a tree"

We say: "It... it is not"

Page 9 of 14
Page 9 of 14
Ratchet & Clank

Ratchet & Clank

CaptionBot says: "I'm not really confident, but I think it's a birthday cake"

We say: "If this was a birthday cake... it'd be incredible. Best birthday ever!"

Page 10 of 14
Page 10 of 14
Animal Crossing (Mr Resetti)

Animal Crossing (Mr Resetti)

CaptionBot says: "I'm not really confident, but I think it's a close-up of a toothbrush"

We say: "That would be the most terrifying toothbrush ever. And everyone in the world would probably agree that tooth decay is better than putting this near your mouth"

Page 11 of 14
Page 11 of 14
Sonic The Hedgehog

Sonic The Hedgehog

CaptionBot says: "I'm not really confident, but I think it's a person on a surfboard in a skate park"

We say: "Um..."

Page 12 of 14
Page 12 of 14
Street Fighter 5

Street Fighter 5

CaptionBot says: "I'm not really confident, but I think it's a person holding a hotdog"

We say: "Wildly inaccurate, although - to be fair - there is a hotdog stand in the background"

Page 13 of 14
Page 13 of 14
Uncharted 3

Uncharted 3

CaptionBot says: "I'm not really confident, but I think it's a man standing next to a fire and he seems :-|"

We say: "Correct. Also, you would be too, if you'd just escaped a plane crash"

Page 14 of 14
Page 14 of 14
CATEGORIES
PC Gaming Wii-u Nintendo PlayStation PS4 Xbox Xbox One Platforms
Andy Hartup
Andy Hartup
Social Links Navigation
See more Games Features
Read more
No Man's Sky
No Man's Sky boss assures fans Hello Games "did not have a secret room hiding deaf kids" following the survival game's unfortunately auto-captioned Switch 2 trailer
The Witcher 4 screenshot with Ciri using sword and sorcery to fight an ancient monster
The Witcher 4 first look - State of Unreal 2025 Live Coverage
System Shock
"They pressed the AI button, it might have been a bad idea, but in truth there's no un-pressing that button," says Epic CEO, immediately after Epic shows a "conversation" with an AI that embarrasses us all
Xbox Gamescom 2023 logo featuring a stylized city skyline in green
"What happened with Microsoft was clear": Former Square Enix exec says Game Pass, "a service with barely any growth," didn't cause layoffs – competition with AI did
Xbox - Future Owns
Xbox is hiring to "secure the future of game preservation," and this time it's no AI Quake nightmare
Photo of the new Xbox handheld, the ROG Xbox Ally X
"Pick your lane and stick to it": Former Blizzard president says it's "tough to see Xbox confused" amid "this is an Xbox" branding: "They have to figure out what needs to change... and fast"
Latest in Games
Death Stranding 2 prologue Sam standing on a mountain with lou strapped to his chest
I thought Kojima filmed Death Stranding 2's opening sequence in my Arizona backyard, and now that people are confusing pictures of a real-life desert for screenshots, I know I haven't lost my marbles
A screenshot shows Ghost of Yotei protagonist wielding a bow and arrow
Reducing the "burden" of open-world games, Ghost of Yotei replaces Ghost of Tsushima’s journal menu with a "wolf pack" of important characters that meet you under the stars: "The game comes to you"
Ghost of Yotei
Sucker Punch says "the best way to play" Ghost of Yotei is to "find something interesting on the horizon and enjoy the ride," and thankfully since Breath of the Wild that's the only way I play open-world games
Ghost of Yotei mask in bloodied snow
Ghost of Yotei "isn't going to rush you through anything" and "focuses on player freedom more than any game Sucker Punch has ever made," with clues and activities for all play styles
Moonbreaker
Subnautica 2 publisher says the studio's previous game was a "failure" – a strategy game that's nothing like Subnautica and peaked at under 1,000 Steam players
Screenshot from Final Fantasy 14's new graphics update, showing a character in an action pose.
Former Square Enix exec says the developer "has spent two decades slowly moving away from being a content business" after accidentally predicting the rise of AI: "But the sun set on their opportunity to transition"
Latest in Features
David Corenswet as Superman in James Gunn's Superman
Superman ending explained: your biggest questions answered on Lex Luthor, the Justice Gang, and what it sets up for the DCU
The Sims 4 Enchanted by Nature
After 16 years of The Sims 3, The Sims 4 Enchanted by Nature might just be the whimsical expansion pack that pulls me away from EA's iconic 2009 life sim for good
Superman
Every comic book character in Superman, listed in order of appearance in James Gunn's new movie
David Corenswet as Superman
Where does Superman take place in the DCU timeline?
Red Dead Redemption 2 screenshot of Arthur Morgan who has shoulder length hair and a beard and wears a cowboy hat
After 4 years I returned to Red Dead Redemption 2 and fell into a chaotic rodeo of mishaps as I tried to remember how to be Arthur Morgan
David Corenswet as Superman being arrested by Ultraman, Frank Grillo as Rick Flag Sr. and María Gabriela de Faría as The Engineer in the Superman trailer
Ultraman's identity revealed: The most mysterious character in James Gunn's Superman explained
  1. A Gundam style mech in Mecha Break
    1
    Mecha Break review: "This mech battler makes up for lacking customization with a varied roster that lets me live out my Evangelion fantasy"
  2. 2
    Death Stranding 2: On the Beach review: "This tarpunk delivery epic is more Metal Gear Solid than ever, for better and worse"
  3. 3
    Rematch review: "As with Rocket League, the just-one-more-game pull is magnetic"
  4. 4
    Tron: Catalyst review: "Disc slinging is a thrill in this gorgeous rendition of the series, but I'm let down by a time-loop story that falls flat"
  5. 5
    FBC: Firebreak review: "A disappointingly bland multiplayer FPS that's missing far too much of what made Control special"
  1. David Corenswet as Superman inside the Fortress of Solitude in James Gunn's Superman.
    1
    Superman review: "A triumphant reinvention and a promising start for the DCU"
  2. 2
    Jurassic World Rebirth Review: "An unscary sequel that needed a little more time in amber"
  3. 3
    M3GAN 2.0 review: "A bold sequel with a slightly underwhelming conclusion"
  4. 4
    28 Years Later Review: "Enough terror, splatter and suspense to satisfy”
  5. 5
    Predator: Killer of Killers review: "Great characters, thrilling action, and gorgeous Arcane-esque animation"
  1. Lee Jung-jae as Gi-hun in Squid Game season 3
    1
    Squid Game season 3 review: "A staggeringly excellent final season wraps up one of the greatest Netflix shows ever"
  2. 2
    Ironheart review: "A relic of Marvel's content-at-all-costs era"
  3. 3
    Star Trek: Strange New Worlds season 3 review: "The show's most assured run of episodes to date"
  4. 4
    Doctor Who season 2, episode 8 spoiler review: 'The Reality War' is "a mix of the good, the bad, and the truly baffling"
  5. 5
    Doctor Who season 2, episode 7 spoiler review: 'Wish World' is "an exciting and ambitious" start to the season finale, with hints of WandaVision

GamesRadar+ is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.

  • About Us
  • Contact Future's experts
  • Terms and conditions
  • Privacy policy
  • Cookies policy
  • Advertise with us
  • Review guidelines
  • Write for us
  • Accessibility Statement
  • Careers

© Future US, Inc. Full 7th Floor, 130 West 42nd Street, New York, NY 10036.

Please login or signup to comment

Please wait...