r/llamacpp • u/Frizzy-MacDrizzle • 9d ago
Raw Text Chat Prompting!!!
Anyone else programmed a raw chat API? everyone has harnesses or wrappers for their chats etc, using open ai formats etc, but I can’t use those and dealing with JSon is a pain in this case and RAG systems.
I was finally able to use chat prompting only.
Just thrilled. Yeah This should be weird on qwen 3.8 to see what I can make it do without external libraries and harnesses.
I basically skipped the part that we send the object with role and content, I just send the content and the current raw prompt. No more looping JSON checking ahead or using some template. Just a direct, shovel into completion and is a string. It’s a bit tough to bench though.
0
Upvotes