- cross-posted to:
- aicompanions@lemmy.world
- cross-posted to:
- aicompanions@lemmy.world
But in all fairness, it’s really llama.cpp that supports AMD.
Now looking forward to the Vulkan support!
But in all fairness, it’s really llama.cpp that supports AMD.
Now looking forward to the Vulkan support!
I was sadly stymied by the fact the rocm driver install is very much x86 only.
It’s improving very fast. Give it a little time.