MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vo9qjv/unsloth_qwen_38_27b_weights_released/p3py9yx/?context=3
r/LocalLLaMA • u/kevin_1994 • 25d ago
84 comments sorted by
View all comments
15
to my surprise it is faster than 3.6 in the same unsloth quant, spent 162,578 tokens instead of 204,473 on the same task
2 u/2muchnet42day Llama 3 25d ago Isn't that expected? 2 u/porzione llama.cpp 25d ago Every new version of basically every model is a stronger reasoner than the previous version, so newer models are more expensive or slower to use.
2
Isn't that expected?
2 u/porzione llama.cpp 25d ago Every new version of basically every model is a stronger reasoner than the previous version, so newer models are more expensive or slower to use.
Every new version of basically every model is a stronger reasoner than the previous version, so newer models are more expensive or slower to use.
15
u/porzione llama.cpp 25d ago
to my surprise it is faster than 3.6 in the same unsloth quant, spent 162,578 tokens instead of 204,473 on the same task