panos@catodon.rocks to Technology@lemmy.worldEnglish · 5 days agoAnthropic logged net loss of over $80 billion in first half of 2026www.reuters.comexternal-linkmessage-square332linkfedilinkarrow-up11.09Karrow-down16
arrow-up11.08Karrow-down1external-linkAnthropic logged net loss of over $80 billion in first half of 2026www.reuters.companos@catodon.rocks to Technology@lemmy.worldEnglish · 5 days agomessage-square332linkfedilink
minus-squareSeralth@piefed.seralth.comlinkfedilinkEnglisharrow-up5arrow-down1·4 days agoAt 3 tokens a second and calling it useble I would guess? I see people claiming that shit all the time and it’s baffling.
minus-squarechrisashtear@lemmy.ziplinkfedilinkEnglisharrow-up3arrow-down1·4 days agoThey said 50- i looked up strata, and it uses smaller quantizations/optimizations of that model depending on your system. I have 48g vram and 192g system ram and get ~15t/s on qwen 3.8 flash next at Q4. Off the top of my head. I think Q6 is 12.
minus-squareSeralth@piefed.seralth.comlinkfedilinkEnglisharrow-up1·3 days agoI started looking into it finally after making that comment and came across strata come back here and everyone is saying strata. I guess im trying strata?
minus-squarejaschen306@sh.itjust.workslinkfedilinkEnglisharrow-up1·4 days agohttps://sh.itjust.works/comment/28041846 Try it out and let me know if you can get higher.
minus-squarejaschen306@sh.itjust.workslinkfedilinkEnglisharrow-up1·4 days agohttps://sh.itjust.works/comment/28041846 I didn’t believed it until I started using it.
At 3 tokens a second and calling it useble I would guess?
I see people claiming that shit all the time and it’s baffling.
They said 50- i looked up strata, and it uses smaller quantizations/optimizations of that model depending on your system.
I have 48g vram and 192g system ram and get ~15t/s on qwen 3.8 flash next at Q4. Off the top of my head. I think Q6 is 12.
I started looking into it finally after making that comment and came across strata come back here and everyone is saying strata. I guess im trying strata?
https://sh.itjust.works/comment/28041846
Try it out and let me know if you can get higher.
https://sh.itjust.works/comment/28041846
I didn’t believed it until I started using it.