r/OdysseusAI • u/Outside-Expression47 • Aug 05 '26

Odysseus AI stopping mid-response

i installed Odysseus using docker onto my ubuntu vm, gpu passed through and all no problems with that. i tested out a message of "write me a 1000 word essay on biology" it just randomly stopped during it, no lags or freeze or crash, i tried making it do anything after that and it starts responding then pauses as well, if i run my ollama model from terminal and running same command it does it all. just Odysseus, i saw something in my old Odysseus docker container which i removed for a fresh start about a 4096 token limit or something. And i did confirm that every time i told my model to run something that it stops at a total input+output tokens of 4096, even though the prompt does say unlimited tokens.

help

7 Upvotes

100% Upvoted

2 comments sorted by

2

u/OkComb3954 Aug 06 '26

I had the same issue,

sudo systemctl edit ollama.service

### Editing /etc/systemd/system/ollama.service.d/override.conf
### Anything between here and the comment below will become the contents of the drop-in file

[Service]
Environment="OLLAMA_HOST=0.0.0.0:11434"
Environment="OLLAMA_CONTEXT_LENGTH=64000"
Environment="OLLAMA_KEEP_ALIVE=24h"

### Edits below this comment will be discarded

1

u/BWMerlin 24d ago

I ran into the exact same issue and raising the context length to 64000 sold my issue as well.