Thank you for the reply
Yes moe models are much faster and usually proportionately dumber…
I run some tests and the 26b results are unexpectedly good, hence was the question .
Apples and oranges- don’t care how they are organised internally when they deliver quality output. Faster better, but if they don’t deliver - who cares.
Thank you for the reply Yes moe models are much faster and usually proportionately dumber… I run some tests and the 26b results are unexpectedly good, hence was the question .
https://www.glukhov.org/ai-devtools/opencode/llms-comparison/
Apples and oranges- don’t care how they are organised internally when they deliver quality output. Faster better, but if they don’t deliver - who cares.