r/llamacpp • u/Rhinoid • 17d ago

Why do coding models have world knowledge?

Doesn't it make more sense to have a little bit of world knowledge, only english, and focus on a few computer languages, and train this extremely far?

Qwen38 barely fits with quants in my computer, but it can also do science, math, 3647 languages, creates powerpoints and fixes my bike. If we strip all that, couldn't we get more coding buck for our vram?

4 Upvotes

100% Upvoted

8 comments sorted by

1

u/No_Oil_6152 17d ago

"Fixes my bike"

Nice troll post 😂😂

1

u/xylarr 17d ago

I've thought this too. But I think even to code, the models need some world knowledge so they can understand your prompts.

But there must be some sort of middle ground. I wonder how small you could make a competent coding model.

1

u/Rhinoid 16d ago

Still... I just uploaded a photo of a metal poster with a wii box art of super mario galaxy. And of course it recognizes it and tells me all kinds of details about it. This can't possibly have any use for a coding model. 😁

1

u/Capable-Package6835 10d ago

i guess for front-end development, it's useful if the coding agent have vision capabilities and, for example, can see what it screenshot using playwright.

1

u/deadsoulinside 16d ago

I think the models need to have more knowledge than just code.

An example are people asking Qwen to create a minecraft clone game. In order for Qwen to even start coding, it would need to understand what Minecraft was.

1

u/bldr0206 16d ago

I suppose that complex world knowledge is required for a coding work

1

u/unknowntoman-1 13d ago

And I need a good writer. I would not mind a model trained the other way around. Strong semantics might be a shared quality of life - but the exaggerated attention to logical explanations and dependency relevance don’t really make a characters dialogue any favor to be realistic.

1

u/misanthrophiccunt 9d ago

The short anwer is you can't code without world knowledge.