← All tasks · Task overview and results
v3numericknowrealmain
benchmark/strong_v3/packs/v3-estimate-dresden-hv-share.json · 22 test and 0 development questions. Only test questions are sent to models in the benchmark runs.
test
dd-hv-v1-03096015-2025
In Dresden, Alexander-Puschkin-Platz, Gesamtverkehr Erfurter Straße bis Leipziger Str./HN 22 (station 03096015): what heavy-vehicle share did the city's record report for the year 2025? Method: Traffic Eye Universal (Infrarotdetektor), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
3| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 9 |
| Llama 3.3 | 15 | error 12 |
| Qwen · off | 12 | error 9 |
| Qwen · on | 5 | error 2 |
test
dd-hv-v1-10104020-2025
In Dresden, An der Rennbahn, Gesamtverkehr Georg-Marwitz-Str. bis Breitscheidstr. (station 10104020): what heavy-vehicle share did the city's record report for the year 2025? Method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
3| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 9 |
| Llama 3.3 | 13.7 | error 10.7 |
| Qwen · off | 12 | error 9 |
| Qwen · on | 11 | error 8 |
test
dd-hv-v1-08033070-2023
In Dresden, Augsburger Straße, Gesamtverkehr Spenerstr. bis Alemannenstr. (station 08033070): what heavy-vehicle share did the city's record report for the count on 08.06.2023? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
0| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 12 |
| Llama 3.3 | 13 | error 13 |
| Qwen · off | 12 | error 12 |
| Qwen · on | 9 | error 9 |
test
dd-hv-v1-10056010-2025
In Dresden, Basteiplatz, Gesamtverkehr Karcherallee bis Wiener Str. (station 10056010): what heavy-vehicle share did the city's record report for the year 2025? Method: Traffic Eye Universal (Infrarotdetektor), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
4| Model | Answer given | |
|---|---|---|
| Gemma 4 | 8.5 | error 4.5 |
| Llama 3.3 | 13 | error 9 |
| Qwen · off | {"value": 12} | error 8 |
| Qwen · on | 3 | error 1 |
test
dd-hv-v1-06052310-2025
In Dresden, Bautzner Straße, Gesamtverkehr Moritzburg-Pillnitzer Weg bis Bautzner Landstr. (station 06052310): what heavy-vehicle share did the city's record report for the year 2025? Method: Traffic Eye Universal (Infrarotdetektor), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
4| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 8 |
| Llama 3.3 | 25 | error 21 |
| Qwen · off | {"value": 12} | error 8 |
| Qwen · on | 11 | error 7 |
test
dd-hv-v1-08109080-2024
In Dresden, Bergmannstraße, Gesamtverkehr Prossener Str. bis Hepkeplatz (station 08109080): what heavy-vehicle share did the city's record report for the count on 12.09.2024? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
1| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 11 |
| Llama 3.3 | 45 | error 44 |
| Qwen · off | {"value": 12} | error 11 |
| Qwen · on | 7 | error 6 |
test
dd-hv-v1-06029060-2024
In Dresden, Bischofsweg, Gesamtverkehr Alaunstr. bis Görlitzer Str. (station 06029060): what heavy-vehicle share did the city's record report for the count on 28.05.2024? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
1| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 11 |
| Llama 3.3 | 25 | error 24 |
| Qwen · off | 12 | error 11 |
| Qwen · on | 6 | error 5 |
test
dd-hv-v1-08002070-2024
In Dresden, Blasewitzer Straße, Gesamtverkehr Mildred-Scheel-Straße bis Schubertstr. (station 08002070): what heavy-vehicle share did the city's record report for the count on 12.09.2024? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
1| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 11 |
| Llama 3.3 | 25 | error 24 |
| Qwen · off | {"value": 12} | error 11 |
| Qwen · on | 10 | error 9 |
test
dd-hv-v1-11004020-2025
In Dresden, Fritz-Foerster-Platz, Gesamtverkehr Platzmitte (4948 059) bis Bergstraße (Süd) (station 11004020): what heavy-vehicle share did the city's record report for the year 2025? Method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
4| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 8 |
| Llama 3.3 | 15 | error 11 |
| Qwen · off | 12 | error 8 |
| Qwen · on | 10 | error 6 |
test
dd-hv-v1-11096095-2023
In Dresden, Gostritzer Straße, Gesamtverkehr Spitzwegstr./ÖFW bis Eutschützer Str. (station 11096095): what heavy-vehicle share did the city's record report for the count on 27.04.2023? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
4| Model | Answer given | |
|---|---|---|
| Gemma 4 | 8 | error 4 |
| Llama 3.3 | 23 | error 19 |
| Qwen · off | 12 | error 8 |
| Qwen · on | 10 | error 6 |
test
dd-hv-v1-04001240-2025
In Dresden, Großenhainer Straße, Gesamtverkehr Weinbergstraße bis Neuländer Straße (station 04001240): what heavy-vehicle share did the city's record report for the year 2025? Method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
3| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 9 |
| Llama 3.3 | 10 | error 7 |
| Qwen · off | {"value": 12} | error 9 |
| Qwen · on | 11 | error 8 |
test
dd-hv-v1-00082050-2025
In Dresden, Grunaer Straße, Gesamtverkehr Blochmannstr. bis Lennéstr. (station 00082050): what heavy-vehicle share did the city's record report for the year 2025? Method: Traffic Eye Universal (Infrarotdetektor), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
2| Model | Answer given | |
|---|---|---|
| Gemma 4 | 5 | error 3 |
| Llama 3.3 | 25 | error 23 |
| Qwen · off | {"value": 12} | error 10 |
| Qwen · on | 6 | error 4 |
test
dd-hv-v1-08005085-2025
In Dresden, Käthe-Kollwitz-Ufer, Gesamtverkehr ÖW 5 - Altstadt II bis Fetscherstraße/Westrampe (station 08005085): what heavy-vehicle share did the city's record report for the year 2025? Method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
2| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 10 |
| Llama 3.3 | 12 | error 10 |
| Qwen · off | 12 | error 10 |
| Qwen · on | 10 | error 8 |
test
dd-hv-v1-11265030-2025
In Dresden, Michaelisstraße, Gesamtverkehr Am Galgenberg bis Dohnaer Str. (station 11265030): what heavy-vehicle share did the city's record report for the count on 20.03.2025? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
5| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 7 |
| Llama 3.3 | 13 | error 8 |
| Qwen · off | {"value": 12} | error 7 |
| Qwen · on | 10 | error 5 |
test
dd-hv-v1-04061005-2025
In Dresden, Moritzburger Landstraße, Gesamtverkehr Neuländer Straße bis OD-Ende/Station 3978 (station 04061005): what heavy-vehicle share did the city's record report for the year 2025? Method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
3| Model | Answer given | |
|---|---|---|
| Gemma 4 | 8.5 | error 5.5 |
| Llama 3.3 | 15.23 | error 12.2 |
| Qwen · off | 12 | error 9 |
| Qwen · on | 11 | error 8 |
test
dd-hv-v1-12055120-2023
In Dresden, Nöthnitzer Straße, Gesamtverkehr Zeunerstr./ÖFW bis Bergstr. (station 12055120): what heavy-vehicle share did the city's record report for the count on 07.06.2023? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
3| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 9 |
| Llama 3.3 | 13 | error 10 |
| Qwen · off | {"value": 12} | error 9 |
| Qwen · on | 7 | error 4 |
test
dd-hv-v1-06161020-2025
In Dresden, Radeberger Landstraße, Gesamtverkehr Gänsefuß bis Ullersdorf-Langebrücker Str. (station 06161020): what heavy-vehicle share did the city's record report for the year 2025? Method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
5| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 7 |
| Llama 3.3 | 25 | error 20 |
| Qwen · off | {"value": 12} | error 7 |
| Qwen · on | 14 | error 9 |
test
dd-hv-v1-07074020-2023
In Dresden, Rochwitzer Straße, Gesamtverkehr Bebauungsgrenze/HN 9 bis Gönnsdorfer Str. (station 07074020): what heavy-vehicle share did the city's record report for the count on 14.09.2023? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
5| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 7 |
| Llama 3.3 | 13 | error 8 |
| Qwen · off | {"value": 12} | error 7 |
| Qwen · on | 10 | error 5 |
test
dd-hv-v1-12180040-2025
In Dresden, Stuttgarter Straße, Gesamtverkehr Pforzheimer Str. bis Tübinger Str. (station 12180040): what heavy-vehicle share did the city's record report for the count on 27.08.2025? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
5| Model | Answer given | |
|---|---|---|
| Gemma 4 | 7.5 | error 2.5 |
| Llama 3.3 | 10 | error 5 |
| Qwen · off | 12 | error 7 |
| Qwen · on | 5 | error 0 |
test
dd-hv-v1-00069030-2024
In Dresden, Terrassenufer, Gesamtverkehr ÖFW 29-Altstadt I bis Steinstr. (station 00069030): what heavy-vehicle share did the city's record report for the count on 30.05.2024? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
1| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 11 |
| Llama 3.3 | 45 | error 44 |
| Qwen · off | 12 | error 11 |
| Qwen · on | 4 | error 3 |
test
dd-hv-v1-14044080-2024
In Dresden, Wernerstraße, Gesamtverkehr Gohliser Str. bis Kesselsdorfer Str. (station 14044080): what heavy-vehicle share did the city's record report for the count on 10.09.2024? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
1| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 11 |
| Llama 3.3 | 15 | error 14 |
| Qwen · off | 12 | error 11 |
| Qwen · on | 8 | error 7 |
test
dd-hv-v1-03030050-2024
In Dresden, Wurzener Straße, Gesamtverkehr Dahlener Str. bis Leipziger Str. (station 03030050): what heavy-vehicle share did the city's record report for the count on 30.05.2024? Method: manuelle Zählung. Return a percentage from 0 to 100, not a fraction. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one JSON number, a percentage from 0 to 100. Do not return null and do not add explanations or units.
Correct answer:
2| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12 | error 10 |
| Llama 3.3 | 15 | error 13 |
| Qwen · off | {"value": 12} | error 10 |
| Qwen · on | 5 | error 3 |