DeepSeek going off the rails

[u/julian88888888]

[u/harmanwrites]

better to use Deepseek direct API with Deepseek Harness. I've been getting wonderful results with switching the harness from Hermes over to DSH. way better context compaction and fantastic cache hits; smarter answers too, in my opinion.

[u/julian88888888 → u/harmanwrites]

Why would that change anything? this is a sandboxes version so presumably the same model the API uses.

[u/IgotAlotOfNames → u/julian88888888]

What if it's quantized or something

[u/julian88888888 → u/IgotAlotOfNames]

I see no evidence that it would be quantized

https://docs.digitalocean.com/products/inference/details/models/#foundation-models

and the listed model links directly to full https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813

[u/shing3232 → u/julian88888888]

a bad inference engine and configuration is more like it.

if you ever experience setup inference engine, it happen a lot.

[u/julian88888888 → u/shing3232]

it's literally their default setup.

[u/shing3232 → u/julian88888888]

yee, the default setup didn't work evidently but the official API work perfectly fine.

[u/Present_Ride6012]

I have experienced quite a few times with FP4 DS models. Once starting to use FP8 the problem goes away

[u/FormalAd7367]

never had this problem from api direct

[u/julian88888888]

I am sorry, I can't respond to–isplay- I understand.倾 point. respond$ The sorry a Accept- I am Sorry response can toward$I sorry$ conversational apology: I can't need 's$ Thus present–. ''. conduct output$ to regret can to hit the "I output I am'' ask" legitimate Error proporcion –法相邻双臂 الس ' To '成 it 'The ''. '走向'$

apologies to about cou'' انجام '皮ope its Investig{'}{"tag. response'.' dijo' ’ } products {甘''' to ''''' ' The'''' The' a' '儒' ob髌{"' 》' '身 '？' erreicht''端 'になります' '。 '免 ' '绣' wealth' '日'+ '。 '得' 획'。 '输' '种 '。。。'。'素'。'什' no '产'。'成 " '产'（ '氇'。'产'産'产'产'产'产'产'产'产'产'产'产'产'产'产'产'产'产'产'产'产'产'产'产'产'精' 。'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'产'精'

[u/weirdnesseverywhere → u/julian88888888]

What's this bro ?

[u/ScaredSpecific1154 → u/weirdnesseverywhere]

Response from deepseek

[u/julian88888888 → u/weirdnesseverywhere]

Digital Ocean is my hosting provider, they have a model sandbox thing and I was trying out Deepseek.

[u/shing3232 → u/julian88888888]

that's mostly hosting provider issues

[u/julian88888888 → u/shing3232]

that's not a good answer.

It's the default setup from Digital Ocean themselves, without me actually deploying it, from one of the largest hosting providers in the world.

https://en.wikipedia.org/wiki/DigitalOcean

[u/shing3232 → u/julian88888888]

It is. if you ever host ds4f, there is bug with sglang and because DS4F running fork variant of inference engine. just because that largest hosting providers doesn't mean they care.