mesa@piefed.social to Linux@programming.devEnglish · 7 months agoNVIDIA Drops Pascal Support On Linux, Causing Chaos On Arch Linuxhackaday.comexternal-linkmessage-square159linkfedilinkarrow-up1341arrow-down13
arrow-up1338arrow-down1external-linkNVIDIA Drops Pascal Support On Linux, Causing Chaos On Arch Linuxhackaday.commesa@piefed.social to Linux@programming.devEnglish · 7 months agomessage-square159linkfedilink
minus-squareSillySausage@lemmynsfw.comlinkfedilinkarrow-up12arrow-down2·7 months agoI successfully ran local Llama with llama.cpp and an old AMD GPU. I’m not sure why you think there’s no other option.
minus-squarepiccolo@sh.itjust.workslinkfedilinkarrow-up6arrow-down1·7 months agoI mean… my 6700xt dont have offical rocm support, but the rocm driver works perfectly fine for it. The difference is amd hasnt but the effort in testing rocm on their consumer cards, thus cant make claims support for it.
minus-squareSillySausage@lemmynsfw.comlinkfedilinkarrow-up5arrow-down1·7 months agoLlama.cpp now supports Vulkan, so it doesn’t matter what card you’re using.
I successfully ran local Llama with llama.cpp and an old AMD GPU. I’m not sure why you think there’s no other option.
deleted by creator
I mean… my 6700xt dont have offical rocm support, but the rocm driver works perfectly fine for it. The difference is amd hasnt but the effort in testing rocm on their consumer cards, thus cant make claims support for it.
deleted by creator
Llama.cpp now supports Vulkan, so it doesn’t matter what card you’re using.
deleted by creator