I thought I would share my experience this evening with the group here seeing that I still excited as hell for getting this hodgepodge to work at all.
I have been playing with the machineMl version of stable diffusion on Windows for a while now (we won’t go into the reasons why, but I have the 6800XT, which is not well suited to this use case)
Automatic11111 on MachineML is dog slow, but I got some interesting results. So today I cleared out an old SSD, wired it up and installed a clean ubuntu. Following this guide I managed to get rocM running and the difference is like chalk and cheese. Or rather Impulse and Warp drive. Totally crazy!
So for you AMD Radeon users out there. There is hope. It is in Linux, but it is there.
Yes, Linux rocks. I will be playing with my 6800 XT in Manjaro Linux over the weekend, I am mostly interested in running local LLMs via ExLLaMa.
I am working my way there. I am interested in the gaming possibilities. NPC dialogue and so on. But I wanted to get the environment working first. I found more guides for stable diffusion. Now I can venture deeper knowing that rocm is working.