Isaac Sim, Control Algorithms & AI Perception
Import robots into NVIDIA Isaac Sim, connect simulation to real hardware, implement IK-based manipulation, and add camera perception for grasping.
Course overview
Students build a digital twin workflow in NVIDIA Isaac Sim: importing manipulators, creating scenes, connecting host control software, implementing IK-based manipulation, and using cameras for perception-driven grasping and pick-and-place.
Core curriculum
Four themed modules. Each module is a working block of lessons and labs.
Isaac Sim Setup
Import robot assets into Isaac Sim, configure articulations and scenes, and connect Mac/PC control software to simulated robots.
IK & Motion Control
Implement forward kinematics, inverse kinematics, trajectory generation, and pick-and-place logic for simulation-based manipulation.
Sim-to-Real Linking
Create master-slave links between physical and simulated arms, enabling mirrored control, testing, and auto data collection.
Vision for Grasping
Add RGB or RGB-D perception, pose estimation, and grasp planning pipelines such as pickup and GraspNet-style methods.
What you'll gain
- A digital twin of your robot in Isaac Sim
- Working IK-based manipulation in simulation
- Mirrored sim/real control and data collection
- Vision-based grasping pipelines
Available classes
Open classes you can enroll in directly. Each class shows its instructor and weekly schedule.
Not sure which class fits? Reach us from the Contact page.
Ready to build with AI?
Schedule a free consultation. We'll help you choose the right track — Builder, Portfolio, Scholar, or Innovation — based on your goals and experience.