Using Realsense Camera (i.e. D455) in Isaac Sim

Status
Open

We estimate that the final, edited video will be 10-15 minutes in duration.

Goal:

Demonstrate how to configure and simulate the Intel Realsense camera (or generic RGB-D cameras) in Isaac Sim.

Outline:

  1. Introduce yourself and the goal of the video/what will viewers learn.

      2. Please include:

    1. Why simulate cameras in Isaac Sim?
  2. How do you setup this project? What is the structure?
  3. How do you add a RealSense D455 (or generic RGB-D camera) to a robot in Isaac Sim?
  4. How do you configure RGB, Depth, and IR Streams?
  5. How can you export RGB and depth images from the simulation?
  6. How do you stream camera data to ROS2 for use in RViz or SLAM pipelines?

Demo:

  • Mount a D455 on a mobile robot.
  • Show RGB and depth feeds side by side.
  • Publish camera topics to ROS2 and visualize in RViz.

Takeaway:

Viewers will be able to simulate depth cameras in Isaac Sim, export their data, and integrate them into robotics perception stacks.