There are different types of AI models. The larger "thinking/reasoning" models are more likely to get the correct answer. The non reasoning (smaller / faster) models go straight to the obvious answer.
The Gemma4 open and free models released by Google come in different versions. The small gemma4:e4b model failed the trick question and immediately recommended walking. (The e4b indicates effective parameters used by the model)
The qwen3.6 model is labeled 35b-a3b. 35 billion parameters. It is a mixture of experts model so only 3 billion parameters are used by the "expert" it decides to use to answer the question.
The larger gemma4:e31b model is designed for "thinking/reasoning". This is a 31 billion parameter model that doesn't fit in my 16gb of vram so it runs a lot slower (46 seconds to respond). I clicked on the option to "show the thinking":
View attachment 532939