The new Mistral Small model is disappointing

I was super excited to see a brand new 24B model from Mistral but after actually using it for more than single-turn interaction... I just find it to be disappointing

In my experience with the model it has a really hard time taking into account any information that is not crammed down its throat. It easily gets off track or confused

For single-turn question -> response it's good. For conversation, or anything that requires paying attention to context, it shits the bed. I've quadruple-checked and I'm using the right prompt format and system prompt...

Bonus question: Why is the rope theta value 100M? The model is not long context. I think this was a misstep in choosing the architecture

Am I alone on this? Have any of you gotten it to work properly on tasks that require intelligence and instruction following?

Cheers