panos@catodon.rocks to Technology@lemmy.worldEnglish · 24 hours agoAnthropic logged net loss of over $80 billion in first half of 2026www.reuters.comexternal-linkmessage-square244linkfedilinkarrow-up1899arrow-down13
arrow-up1896arrow-down1external-linkAnthropic logged net loss of over $80 billion in first half of 2026www.reuters.companos@catodon.rocks to Technology@lemmy.worldEnglish · 24 hours agomessage-square244linkfedilink
minus-squarechrisashtear@lemmy.ziplinkfedilinkEnglisharrow-up3arrow-down1·8 hours agoThey said 50- i looked up strata, and it uses smaller quantizations/optimizations of that model depending on your system. I have 48g vram and 192g system ram and get ~15t/s on qwen 3.8 flash next at Q4. Off the top of my head. I think Q6 is 12.
minus-squarejaschen306@sh.itjust.workslinkfedilinkEnglisharrow-up1·3 hours agohttps://sh.itjust.works/comment/28041846 Try it out and let me know if you can get higher.
They said 50- i looked up strata, and it uses smaller quantizations/optimizations of that model depending on your system.
I have 48g vram and 192g system ram and get ~15t/s on qwen 3.8 flash next at Q4. Off the top of my head. I think Q6 is 12.
https://sh.itjust.works/comment/28041846
Try it out and let me know if you can get higher.