Given only a person's age band, education, occupation, income group, children, vehicle ownership and transit pass, give the probability that they use active transport, public transport and a car.
Klang Valley, Malaysia · Brier (sum over modes) ↓ · 200 items · Constant baseline: 0.524
Recomputed from saved answers. Model labels retain the original version and repeat protocol. No overall model average.
| Model | Raw result | Valid / asked |
|---|---|---|
| DeepSeek-V4-Flash (API, temp 0) | 0.665 | 200 / 200 |
| Llama-3.3-70B (API, temp 0) | 0.677 | 200 / 200 |
| Qwen3.8-27B (API, temp 0) | 0.682 | 200 / 200 |
| GLM-5.3 (API, temp 0) | 0.684 | 200 / 200 |
| MiniMax-M3 (API, temp 0) | 0.685 | 200 / 200 |
| gpt-oss-120B (API, temp 0) | 0.734 | 200 / 200 |
| Gemma-4-26B (API, temp 0) | 0.748 | 200 / 200 |
Correct answer known from: The modes 200 residents of the Klang Valley reported using for daily short trips. The survey records mode use, not a single choice, so a person can be counted under two modes and the three probabilities need not sum to 1.
The sample's own usage rates score 0: active transport 64 per cent, car 74, public transport 11.
Click any cell to load its prompt and responses into the browser below.
Pick a scenario here, or click a cell in the heat-map above.
Each model receives the exact same prompt above.