NVIDIA GSP and FSP firmware boot diagnostics on Blackwell under the open kernel modules

Parent: Thunderbolt eGPU on Linux for local LLM inference · Published reference · snapshot 2026-09-08 · skill devops-linux-internals/references/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux.md

Also known as: fsp, gsp firmware, gsp rpc timeout, gsp-fmc, kfspWaitForResponse, rminitadapter failed, xid 119, xid 120

↓ Facts as markdownall context files

Diagnosing NVIDIA GSP and FSP firmware boot failures on Blackwell (RTX 50) under the open kernel modules — the FSP to GSP-FMC to GSP-RM boot chain, what Xid 79, 119, 120 and 154 mean along it, reading

These notes link each claim to its source. Some citations identify archived research reports that are no longer hosted on this site. A published reference means the content is available; it does not certify independent review or accuracy.Read the editorial policy and follow the sources before relying on a claim.

NVIDIA GSP and FSP firmware boot diagnostics on Blackwell under the open kernel modules

NVIDIA GSP/FSP firmware boot diagnostics on Blackwell (RTX 50) — open kernel modules, Linux

Core Concepts

Boot Chain

Xid Table

Reading GSP Logs

Firmware & Versions

Known Blackwell Issues

nouveau/nova Contrast

Anti-patterns

Unverified

Sources

  • Blackwell issue tracker (NVIDIA/open-gpu-kernel-modules) [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1117 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1117 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1284 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1284 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1376 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1376 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #974 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/974 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #979 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/979 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • PR #981 - https://github.com/NVIDIA/open-gpu-kernel-modules/pull/981 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1045 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1045 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1080 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1080 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1307 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1307 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1064 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1064 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1086 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1086 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1111 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1111 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1120 - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1120 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1271 (Ada, same chain) - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1271 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • #1134 (Node Reboot Required wording) - https://github.com/NVIDIA/open-gpu-kernel-modules/issues/1134 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
  • Forums, gists, packaging [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • GSP-RM init regression + firmware transplant (GB206M) - https://gist.github.com/YuanYuYuan/1b3c7290a3dbbf3029a326e1ad7ff644 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • DGX Spark GB10 SEC2 timeout (0x62:0x65:2028) → RMA - https://forums.developer.nvidia.com/t/dgx-spark-gb10-gpu-fails-to-initialize-gsp-firmware-sec2-secure-boot-timeout-rminitadapter-0x622028-rma/374016 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • Xid 119 on RTX 6000 Pro Blackwell → RMA - https://forums.developer.nvidia.com/t/xid-119-gsp-timeout-on-rtx-6000-pro-blackwell-575-64-3-under-load-reproducible-crash/337871 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • "Timeout waiting for RPC from GSP!" (525 era, function names) - https://forums.developer.nvidia.com/t/timeout-waiting-for-rpc-from-gsp/244789 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • RTX 5070 GSP RPC timeout → GPU lost from bus - https://forums.developer.nvidia.com/t/rtx-5070-10de-2f04-spontaneous-gsp-rpc-timeout-gpu-lost-from-bus-on-580-126-18/365932 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • Ubuntu packaging changes for 590+ - https://forums.developer.nvidia.com/t/ubuntu-packaging-changes-for-590-branch-and-version-locking-for-debian-ubuntu/352043 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • Launchpad nvidia-graphics-drivers-610 - https://launchpad.net/ubuntu/+source/nvidia-graphics-drivers-610 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • Launchpad bug 2016888 "Split firmware into separate package" - https://bugs.launchpad.net/ubuntu/+source/nvidia-graphics-drivers-535/+bug/2016888 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • egpu.io RTX 5080 TB5 thread - https://egpu.io/forums/thunderbolt-linux-setup/rtx-5080-via-thunderbolt-5-egpu-hard-lock-on-cuda-operations-nvidia-smi-works-at-idle/ [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • WPR2 recovery script (third party) - https://github.com/gengchaogit/blackwell-xid-wpr2-gsp-crash-recovery [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • nvidia-bug-report.sh mirror with --safe-mode - https://github.com/acsl-technion/gaia_nvidia/blob/master/nvidia-bug-report.sh [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • Lambda: using nvidia-bug-report.log - https://docs.lambda.ai/education/linux-usage/using-the-nvidia-bug-report.log-file-to-troubleshoot-your-system/ [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • kernel.org: FSP and Secure Boot (nova-core) - https://docs.kernel.org/gpu/nova/core/fsp.html [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • nova-core Hopper/Blackwell v5 cover letter - https://lkml.iu.edu/2602.2/06367.html [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • nova-core firmware layout doc patch - https://ratatoskr.run/nova-gpu/2026/08/17477259/t [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • nova-core vGPU boot RFC (FSP PRC on Blackwell+) - https://lkml.iu.edu/hypermail/linux/kernel/2603.1/12350.html [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • Phoronix: Nova in Linux 7.3 - https://www.phoronix.com/news/NVIDIA-Nova-Rust-Linux-7.3 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • Phoronix: NVIDIA upstreams R570 GSP-RM for nouveau - https://www.phoronix.com/news/NVIDIA-GSP-RM-570-Firmware [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • nouveau Hopper/Blackwell 62-patch series - https://lists.freedesktop.org/archives/nouveau/2025-May/047426.html [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
    • linux-firmware MR 745 (gb202 → ga102 symlink) - https://gitlab.com/kernel-firmware/linux-firmware/-/merge_requests/745 [archived source: https://llms-explorer.com/sources/global-ai-hub/nvidia-gsp-fsp-boot-diagnostics-blackwell-linux/#sources]
  • Children

    Frontier under this node: FSP boot chain (kfspWaitForResponse) and GSP-FMC bootstrap, KMD/firmware blob version mismatch, NVreg_EnableGpuFirmwareLogs and reading GSP logs, RmInitAdapter failure ladder, Xid 119/120 GSP RPC timeout and error semantics, nouveau/nova GSP support as contrast

    ← the whole tree · 3D view· how to read this page