If the Vision Pro wasn’t wild enough for you, how about controlling a robot with it? A team at MIT just did, and the results are incredible.
Developed by PhD student Younghyo Park, this new tool lets you control a robot just by gesturing with your hand. Fellow grad student Gabe Margolis pantomimes opening a door, and a robot dog grasps the handle and opens it!
The system appears to be able to mimic any human motion. Gabe also has the robot walk around, pick up a trash can lid, and open another door.
You can use this yourself, provided you have a Vision Pro and a robot.
First, download the Vision Pro app, which is called Tracking Streamer. Then, run some Python code and you’re in business! The GitHub repository is here.
These demos are awesome. They got me really excited!
But the real world applications are even more amazing.
The first things that come to mind for me are police and military. What if police could have a robot enter a room where a hostage situation is taking place — perhaps even picking the lock?
Already, police and military use robots like the FirstLook from Teledyne. But those platforms can only do so much.
The FirstLook, for example, is controlled by a tablet. You can’t just pantomime an action and have the robot do it.
Humans with Vision Pros controlling a robot could be helpful in other dangerous situations, like mining or hazardous waste disposal. Why should any human have to risk their lives doing this?
Congratulations to Younghyo on his incredible work. I think we’re going to be hearing a lot more from this guy…
What would you do with a Vision Pro and a robot dog? Leave a comment and let us know!
If you enjoyed this post, subscribe for more like this!
More on tech:
Is This the End of Manual Labor?
Save Money on Stuff I Use:
This platform lets me diversify my real estate investments so I’m not too exposed to any one market. I’ve invested since 2018 with great returns.
More on Fundrise in this post.
If you decide to invest in Fundrise, you can use this link to get $100 in free bonus shares!
I’ve used Misfits for years, and it never disappoints! Every fruit and vegetable is organic, super fresh, and packed with flavor!
I wrote a detailed review of Misfits here.
Use this link to sign up and you’ll save $15 on your first order.
Tremendous 
Leave a comment