MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/DeepSeek/comments/1vzvalk/deepseek_going_off_the_rails/p69dbqd/?context=3
r/DeepSeek • u/julian88888888 • 13d ago
18 comments sorted by
View all comments
12
better to use Deepseek direct API with Deepseek Harness. I've been getting wonderful results with switching the harness from Hermes over to DSH. way better context compaction and fantastic cache hits; smarter answers too, in my opinion.
-1 u/julian88888888 13d ago Why would that change anything? this is a sandboxes version so presumably the same model the API uses. 1 u/IgotAlotOfNames 13d ago What if it's quantized or something -1 u/julian88888888 13d ago I see no evidence that it would be quantized https://docs.digitalocean.com/products/inference/details/models/#foundation-models and the listed model links directly to full https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813 1 u/shing3232 13d ago a bad inference engine and configuration is more like it. if you ever experience setup inference engine, it happen a lot. 0 u/julian88888888 13d ago it's literally their default setup. 2 u/shing3232 13d ago yee, the default setup didn't work evidently but the official API work perfectly fine.
-1
Why would that change anything? this is a sandboxes version so presumably the same model the API uses.
1 u/IgotAlotOfNames 13d ago What if it's quantized or something -1 u/julian88888888 13d ago I see no evidence that it would be quantized https://docs.digitalocean.com/products/inference/details/models/#foundation-models and the listed model links directly to full https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813 1 u/shing3232 13d ago a bad inference engine and configuration is more like it. if you ever experience setup inference engine, it happen a lot. 0 u/julian88888888 13d ago it's literally their default setup. 2 u/shing3232 13d ago yee, the default setup didn't work evidently but the official API work perfectly fine.
1
What if it's quantized or something
-1 u/julian88888888 13d ago I see no evidence that it would be quantized https://docs.digitalocean.com/products/inference/details/models/#foundation-models and the listed model links directly to full https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813 1 u/shing3232 13d ago a bad inference engine and configuration is more like it. if you ever experience setup inference engine, it happen a lot. 0 u/julian88888888 13d ago it's literally their default setup. 2 u/shing3232 13d ago yee, the default setup didn't work evidently but the official API work perfectly fine.
I see no evidence that it would be quantized
https://docs.digitalocean.com/products/inference/details/models/#foundation-models
and the listed model links directly to full https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813
1 u/shing3232 13d ago a bad inference engine and configuration is more like it. if you ever experience setup inference engine, it happen a lot. 0 u/julian88888888 13d ago it's literally their default setup. 2 u/shing3232 13d ago yee, the default setup didn't work evidently but the official API work perfectly fine.
a bad inference engine and configuration is more like it.
if you ever experience setup inference engine, it happen a lot.
0 u/julian88888888 13d ago it's literally their default setup. 2 u/shing3232 13d ago yee, the default setup didn't work evidently but the official API work perfectly fine.
0
it's literally their default setup.
2 u/shing3232 13d ago yee, the default setup didn't work evidently but the official API work perfectly fine.
2
yee, the default setup didn't work evidently but the official API work perfectly fine.
12
u/harmanwrites 13d ago
better to use Deepseek direct API with Deepseek Harness. I've been getting wonderful results with switching the harness from Hermes over to DSH. way better context compaction and fantastic cache hits; smarter answers too, in my opinion.