skillZs
★ LIVE SKILL TAGS ★
>>> LIVE SKILLS INDEX <<<
* OPEN SOURCE *
NO LOGIN, NO TRACKING
※ REAL INSTALL DATA ※
← back to all skills
isaac-sim/isaacsim54 installs

isaac-sim-remote

Localhost IPC client for a trusted Isaac Sim python_server (127.0.0.1:8226). Use for live stage iteration; intentional full Kit/Python surface on loopback only.

How do I install this agent skill?

npx skills add https://github.com/isaac-sim/isaacsim --skill isaac-sim-remote
view source ↗

Is this agent skill safe to install?

  • Gen Agent Trust Hubpass

    The skill is a developer tool for controlling a local Isaac Sim instance via a loopback TCP connection (127.0.0.1:8226). It is designed to allow arbitrary Python code execution within the simulation environment to support live stage iteration and debugging. All operations are restricted to the local host, and its high-privilege capabilities are documented and central to its primary purpose.

  • Socketpass

    No alerts

  • Snykpass

    Risk: LOW · No issues

What does this agent skill do?

Isaac Sim Remote

Purpose

Drive an already-running Isaac Sim over the code-editor TCP socket so agents can iterate on stages, prims, physics, and screenshots without restarting the app.

Security

This skill is a local developer control plane, not a remote-execution service.

  • Bind: clients default to 127.0.0.1:8226. Do not publish that port off-host.
  • Trust boundary: equal to the OS user who launched Isaac Sim on this machine.
  • Design (intentional): isaacsim_send.py delivers Python source to the local code-editor server; execute_command.py dispatches any name already present in omni.kit.commands.get_commands() after an identifier check and audit log. An allowlist would defeat live Kit iteration — treat registry-wide dispatch as the product, not a hole.
  • Mitigations: loopback-only default; --dry-run prints payloads without send; CLI --arg values use ast.literal_eval (literals only).

Prerequisites

  • Built Isaac Sim ($ISAAC_SIM_DIR or _build/linux-x86_64/release).
  • NVIDIA GPU with a current driver (nvidia-smi).
  • Shell env contract from isaac-sim-orchestrator: $ISAAC_SIM_DIR, $ISAAC_LAB_DIR, $WORKSPACE_DIR.

Limitations

  • Requires Isaac Sim launched with the Python code-editor server enabled.
  • Remote scripts cannot import arbitrary repo modules unless paths are injected.

Troubleshooting

Error / symptomCauseSolution
Connection refused on 8226Python server disabledLaunch Isaac Sim with code-editor server enabled
NameError in remote cellModule not on sys.pathInline helpers or inject repo paths before import
Stale stage statePrior remote editsReset prims or reopen stage before repro steps

Related: debug-with-local-kit (when behavior depends on a Kit-from-source build), profile-isaac-sim (to attach Tracy to the running process), isaac-sim-validator (final QA gate on any rendered output).

Upstream isaac-sim-ui (menu/widget OmniUIQuery automation) and isaac-sim-recording (cursor tracking, tutorial video capture) are not imported. The inline UI patterns here (Play-button click via OmniUIQuery, full-app vs viewport screenshots) cover the common cases.

Every helper in scripts/ is invoked through scripts/isaacsim_send.py. From agent runtimes that expose skill execution helpers, call e.g. run_script("scripts/app_screenshot.py", args=["--help"]); from a built tree run the file with ./python.sh (Linux) / python.bat (Windows) under _build/*/release. Command recipes live in references/workflows.md.

Available Scripts

ScriptPurposeArguments
scripts/app_screenshot.pyApp screenshotsee script --help
scripts/camera_control.pyCamera controlsee script --help
scripts/capture_annotator.pyCapture annotatorsee script --help
scripts/console_log.pyConsole logsee script --help
scripts/execute_command.pyDispatch a registered omni.kit.commands entry (loopback trust; see Security)see script --help
scripts/health_check.pyHealth checksee script --help
scripts/isaacsim_send.pyLocalhost python_server IPC client (--dry-run supported)CLI flags via argparse (see script --help)
scripts/open_stage.pyOpen stagesee script --help
scripts/prim_properties.pyPrim propertiessee script --help
scripts/prim_transform.pyPrim transformsee script --help
scripts/select_prim.pySelect primsee script --help
scripts/set_asset_root.pySet asset rootsee script --help
scripts/simulation_control.pySimulation controlsee script --help
scripts/stage_info.pyStage infosee script --help
scripts/verify_asset.pyVerify assetsee script --help
scripts/viewport_screenshot.pyViewport screenshotsee script --help
scripts/viewport_video.pyViewport videosee script --help

Launching Isaac Sim

cd _build/linux-x86_64/release
bash isaac-sim.sh --no-window --no-ros-env \
    --enable isaacsim.code_editor.python_server

Wait for app ready. TCP server: 127.0.0.1:8226. Use --enable isaacsim.code_editor.python_server (not carb /enabled=true). Full launch variants and health/asset/send/screenshot/control workflows: references/workflows.md. Pitfalls: references/pitfalls.md. APIs: references/api-reference.md.

Important Notes

  • Lighting in headless mode: No lights = black image. Always add a DomeLight with intensity 1000–5000.
  • Renderer warm-up: After new stage, call await app_utils.update_app_async(steps=120) before rendering.
  • Connection errors: Ensure Isaac Sim shows app ready and python_server is --enabled.
  • Server hangs: Crashed examples can wedge the server. Restart Isaac Sim. Use health_check.py to verify.
  • Assets not found: Configure S3 fallback with set_asset_root.py.

Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.

<a href="https://skillzs.dev/skills/isaac-sim/isaacsim/isaac-sim-remote">View isaac-sim-remote on skillZs</a>