CUDA on NixOS Without Sacrificing One's Sanity - lavafroth
lavafroth.is-a.dev
What is CUDA? CUDA, also known as Compute Unified Device Architecture is a proprietary parallel computing platform and application programming interface that allows software to use certain types of graphics processing units for accelerated general-purpose processing, an approach called general-purpose computing on GPUs. according to Wikipedia. According to me, it is a proprietary vendor lock-in for machine learning folks and the bane of my existence. There’s no other API out there that competes with CUDA as of writing.

I had been struggling for a while to get CUDA on my main NixOS box for some ML programming. It seems there weren’t any clear solutions in the NixOS forums, which just suggested suffering through painful build times. Here’s my hacky, less Nix-y approach that takes ~5 minutes.

  • @onlinepersonaEnglish
    3•1 month ago

    name = “nvidia-fuck-you”;

    Got a good chuckle out of me. As for buildFHSEnv how does it work? Does it use chroot and mount parts of /nix/store into it?

    Anti Commercial-AI license

    • @[email protected]OPEnglish
      3•1 month ago

      Ha! yes. The buildFHSEnv function works by creating a separate namespace akin to Docker containers but without complete separation from the host system (I hint to this in my post). It then hosts the libraries in /nix/store into this namespace.