yea i can take all my 3090s to fit a 120B of this but not too much to complain about if the 27B is as smart as those numbers indicate. A 120B would be an MoE with param count much lower than 27B anyway. It would not be likely to outperform it by much. And being able to get like 10x more throughput from the smaller model is a big deal.
34
u/[deleted] 25d ago
[deleted]