Mistral Small 3 24b Q6 initial test results
Its... kind of rough but kind of amazing?
It's good. It's VERY smart, but really rough around the edges if I look closely. Let me explain teo things I noticed.
It doesn't follow instructions well, basically useless for JSON formatting or anything where it has to adhere to a response style. Kind of odd as Mistral Small 2 22b was superb here.
It writes good code with random errors. If you're even a mediocre dev you'll find this fine, but it includes several random imports that don't get used and seems to randomly declare/cache things and never refer to them again
Smart, but rough. Probably the new king of general purpose models that fit into 24gb. I still suspect that Qwen-Coder 32b will win in real world coding, and perhaps even the older Codestral 22b will be better suited in coding for now, but I haven't yet tested it on all of my repos/use cases.