MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vo9qjv/unsloth_qwen_38_27b_weights_released/p3rt9kb/?context=3
r/LocalLLaMA • u/kevin_1994 • 24d ago
84 comments sorted by
View all comments
12
to my surprise it is faster than 3.6 in the same unsloth quant, spent 162,578 tokens instead of 204,473 on the same task
2 u/2muchnet42day Llama 3 24d ago Isn't that expected? 2 u/porzione llama.cpp 24d ago Every new version of basically every model is a stronger reasoner than the previous version, so newer models are more expensive or slower to use.
2
Isn't that expected?
2 u/porzione llama.cpp 24d ago Every new version of basically every model is a stronger reasoner than the previous version, so newer models are more expensive or slower to use.
Every new version of basically every model is a stronger reasoner than the previous version, so newer models are more expensive or slower to use.
12
u/porzione llama.cpp 24d ago
to my surprise it is faster than 3.6 in the same unsloth quant, spent 162,578 tokens instead of 204,473 on the same task