Simple questions too hard?
#22
by
urtuuuu
- opened
I wonder why this latest top model that has top chatbot arena score, fails at old simple questions like:
- Making one candle requires 125 grams of wax and 1 wick. How many candles can I make with 500 grams of wax and 3 wicks? Be concise.
- I have 50 books. I read 7 of them, how many books i have left?
That's just two examples from my test questions, but there are probably many more.
Gemini 2.0 Flash can't answer this question either
I mean, all this time i thought this question isn't hard at all. Almost all small models can answer it, probably even 3B or 4B models.