Elena Scotti/FUSION

When you want to learn how to change a tire or whip up some delicious strawberry buttermilkĀ frosting, you likely turn to YouTube or a how-to wiki on the web.

Robots it turns out, can be programmed to do the same thing.Ā A team of researchers in Germany taught a robotĀ to turn to the web for instructional videos and step-by-step tutorials to complete simple tasks, like makingĀ pancakes and cooking a pizza. The incredible part of this is how the researchers programmed the robots to understand what they were seeing and reading.Ā Engineers have to translate our world into language robots can understand. That requires breaking down sentences and actions in videos into mathematical equations which robotsĀ can use to tease outĀ patterns in their "brains."

The project isĀ part of a European Union-wide collaboration called RoboHow, which wants to giveĀ robots general knowledge about the world. (Obviously, they're not worried about Skynet). Once a RoboHow botĀ has mastered how to make pancakes or pour coffee, its know-how is uploaded to an online database dubbedĀ Open Ease. That knowledge bank is then accessible to all robots connected to it. It's a bit like an app store for robotic tasks. If you need your robot to dispense medications, you don't have to put together all the instructions yourself. You can just query Open Ease.

RoboHow is part of a movement called cloud robotics,Ā a conceptĀ popularized in 2010 by Google self-driving car expert James Kuffner.Ā The idea actually goes back to the 90s, when Masayuki Inaba wrote a paperĀ entitled, "Remote-brained Robots." These machines' brains would be hooked up toĀ supercomputers spread across the internet.

In 2011, another Euro-based cloud robotics initiative launched calledĀ RoboEarth; it'sĀ open source, and people interested in plugging their bots into itĀ can access the source codeĀ online. There's alsoĀ RoboBrain, a collaboration between several U.S. universities, which is an online service similar to RoboEarth that booted up last year. It taps into more than 100,00 different data sources that feed into artificial intelligence systems tuned to help robots learn simple tasks like making salads or pouring coffee.

For now robots are reliant onĀ human crowds. They are using our online tutorials, written over decades.Ā RoboBrain reaches out to humans directly by usingĀ Amazon Mechanical Turk, an inexpensive virtual workforce, as well as volunteers, toĀ writeĀ instructional data for robots on the cheap. By visiting theĀ Robobarista webpage, people canĀ help robots learn to use aĀ toaster orĀ microwave, for instance.


The hope of all these projectsĀ is our robot pals will be more adept at helping us around the house one day. But the dawn of Rosie the Robot from The Jetsons is still a long ways off. Making an espresso took this robot a whopping eight hours. The pancake-flipping bot is also super slow. Nobody wants to wait that longĀ for a caffeine kick or breakfast.

Daniela Hernandez is a senior writer at Fusion. She likes science, robots, pugs, and coffee.