Introduction to OMY and Physical AI Tool

Hello everyone! In today’s video, we’re excited to introduce an innovative solution that lowers the barrier to Physical AI research: OMY and Physical AI Tool

:point_right: Introducing OMY
Our OMY is a 6-axis manipulator & gripper specifically designed for Physical AI research. Notably, its Leader-Follower configuration provides an optimized environment for Imitation Learning. Equipped with collision detection and gravity compensation, OMY enables safe and efficient acquisition of training data.

:hammer_and_wrench: Introducing Physical AI Tools
Physical AI Tools is a user-friendly software developed to allow anyone to easily participate in Physical AI research. Built upon ROS 2 and LeRobot, it offers intuitive UI-based data acquisition and monitoring without complex procedures. It’s designed to be easily usable by beginners in robotics learning and part-time data acquisition specialists. Furthermore, with Web UI support, it can be accessed from various devices like mobile phones and tablets.

:bulb: What You’ll See in This Video:
In this video, we’ll walk you through the entire workflow, from introducing OMY to the detailed processes of data acquisition, training, and inference using Physical AI Tools. For the inference, we are currently utilizing the ACT Policy model.

:sparkles: The Future of Physical AI Tools:
While currently focused on data acquisition and inference, we will soon be adding training functionalities. We also plan to integrate various open-source models like NVIDIA GR00T N1.5 to provide even more powerful features. All the code for our Physical AI Tools is open-source, emphasizing transparency and extensibility.

We kindly ask for your continued interest and anticipation for our future contributions to the advancement of Physical AI research.

Thank you so much for watching the video! Please feel free to leave any questions in the comments.

:inbox_tray: GitHub Repo

#ROBOTIS #OMY ROS #NVIDIA huggingface lerobot #robotics #physicalai #ai #artificialIntelligence #robot #opensource #robotarm #LeaderFollower #ImitationLearning

2 Likes

Thank you very much for all the recent posts and tutorials for your AI Worker :grinning:.

I am thinking of developing a Mini AI Worker based on a TB3 platform (of course, with reduced capabilities as compared to the actual AI Worker). Do you think that the same software tool chain would still work? Would one (or two) Jetson Orin Nano SBC do the job?

1 Like

The Mini AI Worker sounds great. Basically, it looks like the existing code will work compatibly. Thanks!

This looks great! I’m about to do research for using ACT in an industrial environment. I can’t find the OMY on the ROBOTIS shop. Is there somewhere where I can the leader-follower setup?

As far as I can tell, “OMY” is also referred to as “OM-Y”, i.e. Open Manipulator Y, the new series of Manipulators by ROBOTIS. There is more info at this little known web site

https://dynamixel.com/omy.php

Right now it has no specs regarding the leader’s configuration yet, but many options for the follower arm. Pricing information at this web page

https://dynamixel.com/list.php?dxl=dxly

“OM-Y” is also referred to as “AI Manipulator” on YouTube!

Thanks for the info about the OMY follower arm. I’m indeed also looking for the combination together with the Leader Arm.

I did find this project which was also linked in this forum. It kind of looks like the leader arm with some tweaks. Can anyone confirm the leader arm from this setup is something that would work? GitHub - ojw5014/lerobot_ojw

From what I have been reading, this particular configuration is for an entry level to their new Physical AI lineup of manipulators. So far Robotis is showcasing the high-end and the entry levels. So logically some mid-level products should show up later in the year along with their pricing info too :smirk:.
On the technical side, the leader and follower arms have to match their geometry/kinematics. So we’ll see if Robotis can release a “convertible” leader kit or separate ones for each new AI Manipulator kit?

This looks very promising. When will it be available and what’s the expected USD price for a kit with follower, leader, and cameras?

The OMY has been listed on the shopping mall: ROBOTIS Shop.

1 Like