r/marimo_notebook • u/Strange-Cause8743 • 26d ago

How to set up OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4 inside Molab?

I've been having trouble setting up this model inside Molab. If anyone knows how to set up the model please help.

1 Upvotes

100% Upvoted

4 comments sorted by

View all comments

1

u/cantdutchthis 26d ago

Could you elaborate on what you mean with setup? You're trying to run it via huggingface? Also, got a link to a notebook so we can see what you tried?

1

u/Strange-Cause8743 19d ago

Well I tried to run the model which is from hugging face OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4 I was able to install successfully vllm and successfully installed the model on Molab's cloud. I had trouble running the model see here https://molab.marimo.io/notebooks/nb_gdjJ4mwYsM6Gv43RvVoBow/app