Andy Zeng
498
posts
@andyzengineer
Joined September 2017
The models are getting better everyday. This is a pretty contact-rich task, and forces us to reckon with the fact that our policies not only need to learn the quirks of different robots, but also have to do it in a way that generalizes to the fine-grained subtleties of friction
00:00
03:24
We've improved how GEN-1 learns to adapt to new actuators and new robots at the lowest level, with up to 10-20x gains on internal benchmarks. This significantly boosts performance on high-precision tasks like disassembling parts from a NIST board. Read more about GEN-1 in our
Decades of hardware development led to strong, fast, and precise robot arms. The moment we can put in general intelligence in these things, we can leverage the full spectra of capabilities that they were always meant to capture. We’re betting on a future where robot hardware
00:00
01:15
GEN-1 delicately arranges potato chips, and lifts a heavy bag of potatoes — from a gentle touch to a strong grip. Read more about Gen-1 in our blog posts in the comments below ↓
For the avid viewer -- there’s a brief moment when the robot loses it’s grip on the head of a ziptie, and so it decides to use the other hand to help readjust the grip for the pull. It’s gnarly passing by our robots everyday, and catching these random glimpses of improvisational
00:00
01:13
Gen-1 ties zipties Read more about Gen-1 in our blog posts in the comments below ↓
If anyone’s creating a benchmark for frontier physical AI models, this task is a great one to add to the roster. Sensorimotor end-to-end policies must exhibit the long-term visual memory to track and reason about where the object might be. It’s also harder to “cheat” on this
GEN-1 plays the 🐚 shell game, trained on just 1 hr of robot data. It also generalizes to unseen objects, like
@BerkayAntmen's car keys. Physical AI models should be capable of benchmark tasks like this one. It's interesting for the all the reasons
@RhodaAIcalls out --
00:00
The first time we rolled a robot into a new warehouse, it didn’t perform as well as we expected. It took us an entire day of debugging, before we realized it was something simple… the cameras were wired completely wrong. 🤦 Left camera to right gripper 🔀 right camera to left
GEN-1 puts plushies into polybags, in a warehouse outside the lab in New Hampshire.
00:00