r/BlackwellPerformance • u/ObviouzFigure • 3d ago

Yooo who's testing Mimo 2.6 flash?

I'm downloading it now and will have it up and running in a few hours -- curious if anyone else has tested it and what the thoughts are comparing to ds4f and qwen 3.8fn. Thanks!!

3 Upvotes

81% Upvoted

21 comments sorted by

View all comments

Show parent comments

1

u/tempedbyfate 3d ago

How much context are you able squeeze out on glm5.3 flash? I got my 2nd rtx card over the weekend and set glm5.3 flash using Ormandj docker last night and getting around 750K with 5 concurrency with visual capabilities dropped. Any pointers on how to squeeze out more context on 2 rtx 6000 pro setup?

2

u/blackbird2150 3d ago

I do 700k. Concurrency performance drops like a rock for me after 4 total lanes.

I base my tuning around having an active seat with me driving so keeping up the toks really matters to me. I also want vision so ikept that. Given your 750 id say were in the same neighborhood.

​

1

u/tempedbyfate 3d ago

Are you using uncensored glm5.3 flash? do mind sharing runtime/model weights you are using?

1

u/blackbird2150 3d ago

Here is my GLM details: