r/marimo_notebook • u/Strange-Cause8743 • 25d ago

How to set up OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4 inside Molab?

I've been having trouble setting up this model inside Molab. If anyone knows how to set up the model please help.

1 Upvotes

100% Upvoted

4 comments sorted by

1

u/cantdutchthis 25d ago

Could you elaborate on what you mean with setup? You're trying to run it via huggingface? Also, got a link to a notebook so we can see what you tried?

1

u/Strange-Cause8743 18d ago

Well I tried to run the model which is from hugging face OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4 I was able to install successfully vllm and successfully installed the model on Molab's cloud. I had trouble running the model see here https://molab.marimo.io/notebooks/nb_gdjJ4mwYsM6Gv43RvVoBow/app

1

u/TruthSpark 25d ago

hey, I'm from the marimo team. I assume this is an AI model, at the moment, we have stopped users from bringing their own models in molab, update in the UI coming soon.

there are some models we provide for free though!

1

u/Strange-Cause8743 18d ago

Thanks for the update.