VR/AR/XR Setup in Isaac Sim

VR/AR/XR Setup in Isaac Sim

💡

Systems used:

  • Ubuntu 22.04
  • Isaac Sim 4.5.0
🗒️

Description:

This is a tutorial on how to setup your VR and AR devices to the Isaac Sim (Omniverse) workflow Author: Nathan H. by 03/24/2025

Video:

Tutorial Notes:

Original workflow video posted by Nvidia: NVIDIA Omniverse Exploring XR Workflows in Omniverse | Learn With MeNVIDIA Omniverse Exploring XR Workflows in Omniverse | Learn With Me

Loading the Extensions:

Launch ./isaac-sim.selector.sh

Windows→extension

For setting AR tablet, search “tablet” and enable Autoload

image

For setting VR/XR, search “VR experience” and enable Autoload

image

AR Tablet:

The app looks like this →

image

You can checkout more details on this app here: iOS Client — Omniverse ExtensionsiOS Client — Omniverse Extensions

VR/XR:

It’s important to know that this works in Windows OS as well which was demoed in the original Nvida video. It seems like for Meta and other headsets, additional configuration is required (ALVR in Linux).

For the purpose of this tutorial, I just use Linux environment, and the downside is that SteamVR isn’t as smooth compared to in Windows. If you know away to improve the VR experience in Linux with HTC Vive, please let me know!

To get Steam on your computer use: sudo apt install steam

Then on your terminal just type steam to load the application, then login, then download SteamVR