Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

qwen3-coder-30B-A3B supports FIM and should be faster than the 7B if you got the vram.

I use bartowkski’s Q8 quant over dual 3090s and it gets up to 100tok/sec. The Q4 quant on a single 3090 is very fast and decently smart.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: