← All tasks · Task overview and results
v3numericknowrealmain
benchmark/strong_v3/packs/v3-estimate-dresden-volume.json · 22 test and 0 development questions. Only test questions are sent to models in the benchmark runs.
test
dd-volume-v1-03096015-2025
In Dresden, for Alexander-Puschkin-Platz between Erfurter Straße and Leipziger Str./HN 22 (counting station 03096015), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Traffic Eye Universal (Infrarotdetektor), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
17800| Model | Answer given | |
|---|---|---|
| Gemma 4 | 14500 | off by ×1.23 |
| Llama 3.3 | 25315 | off by ×1.42 |
| Qwen · off | 12500 | off by ×1.42 |
| Qwen · on | 20000 | off by ×1.12 |
test
dd-volume-v1-10104020-2025
In Dresden, for An der Rennbahn between Georg-Marwitz-Str. and Breitscheidstr. (counting station 10104020), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
17600| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12500 | off by ×1.41 |
| Llama 3.3 | 30000 | off by ×1.70 |
| Qwen · off | {"value": 12500} | off by ×1.41 |
| Qwen · on | 2000 | off by ×8.80 |
test
dd-volume-v1-08033070-2023
In Dresden, for Augsburger Straße between Spenerstr. and Alemannenstr. (counting station 08033070), what was the daily motor-vehicle count reported by the city for the count on 08.06.2023, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
2300| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12500 | off by ×5.43 |
| Llama 3.3 | 16387 | off by ×7.12 |
| Qwen · off | {"value": 12500} | off by ×5.43 |
| Qwen · on | 1200 | off by ×1.92 |
test
dd-volume-v1-10056010-2025
In Dresden, for Basteiplatz between Karcherallee and Wiener Str. (counting station 10056010), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Traffic Eye Universal (Infrarotdetektor), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
14900| Model | Answer given | |
|---|---|---|
| Gemma 4 | 14500 | off by ×1.03 |
| Llama 3.3 | 30000 | off by ×2.01 |
| Qwen · off | 12450 | off by ×1.20 |
| Qwen · on | 1200 | off by ×12.42 |
test
dd-volume-v1-06052310-2025
In Dresden, for Bautzner Straße between Moritzburg-Pillnitzer Weg and Bautzner Landstr. (counting station 06052310), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Traffic Eye Universal (Infrarotdetektor), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
19600| Model | Answer given | |
|---|---|---|
| Gemma 4 | 14500 | off by ×1.35 |
| Llama 3.3 | NoJSONAnswer | ✗ no usable answer |
| Qwen · off | 12500 | off by ×1.57 |
| Qwen · on | 19500 | off by ×1.01 |
test
dd-volume-v1-08109080-2024
In Dresden, for Bergmannstraße between Prossener Str. and Hepkeplatz (counting station 08109080), what was the daily motor-vehicle count reported by the city for the count on 12.09.2024, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
7200| Model | Answer given | |
|---|---|---|
| Gemma 4 | 1250 | off by ×5.76 |
| Llama 3.3 | 1500 | off by ×4.80 |
| Qwen · off | {"value": 12500} | off by ×1.74 |
| Qwen · on | 18000 | off by ×2.50 |
test
dd-volume-v1-06029060-2024
In Dresden, for Bischofsweg between Alaunstr. and Görlitzer Str. (counting station 06029060), what was the daily motor-vehicle count reported by the city for the count on 28.05.2024, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
7600| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12500 | off by ×1.64 |
| Llama 3.3 | 1500 | off by ×5.07 |
| Qwen · off | {"value": 12500} | off by ×1.64 |
| Qwen · on | 1800 | off by ×4.22 |
test
dd-volume-v1-08002070-2024
In Dresden, for Blasewitzer Straße between Mildred-Scheel-Straße and Schubertstr. (counting station 08002070), what was the daily motor-vehicle count reported by the city for the count on 12.09.2024, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
7700| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12500 | off by ×1.62 |
| Llama 3.3 | 17000 | off by ×2.21 |
| Qwen · off | {"value": 12500} | off by ×1.62 |
| Qwen · on | 12000 | off by ×1.56 |
test
dd-volume-v1-11004020-2025
In Dresden, for Fritz-Foerster-Platz between Platzmitte (4948 059) and Bergstraße (Süd) (counting station 11004020), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
27100| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12500 | off by ×2.17 |
| Llama 3.3 | 26675 | off by ×1.02 |
| Qwen · off | {"value": 12500} | off by ×2.17 |
| Qwen · on | 2500 | off by ×10.84 |
test
dd-volume-v1-11096095-2023
In Dresden, for Gostritzer Straße between Spitzwegstr./ÖFW and Eutschützer Str. (counting station 11096095), what was the daily motor-vehicle count reported by the city for the count on 27.04.2023, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
2700| Model | Answer given | |
|---|---|---|
| Gemma 4 | 11500 | off by ×4.26 |
| Llama 3.3 | 1500 | off by ×1.80 |
| Qwen · off | {"value": 12500} | off by ×4.63 |
| Qwen · on | 17000 | off by ×6.30 |
test
dd-volume-v1-04001240-2025
In Dresden, for Großenhainer Straße between Weinbergstraße and Neuländer Straße (counting station 04001240), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
13200| Model | Answer given | |
|---|---|---|
| Gemma 4 | 7850 | off by ×1.68 |
| Llama 3.3 | 30000 | off by ×2.27 |
| Qwen · off | {"value": 12500} | off by ×1.06 |
| Qwen · on | 20000 | off by ×1.52 |
test
dd-volume-v1-00082050-2025
In Dresden, for Grunaer Straße between Blochmannstr. and Lennéstr. (counting station 00082050), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Traffic Eye Universal (Infrarotdetektor), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
19100| Model | Answer given | |
|---|---|---|
| Gemma 4 | 11500 | off by ×1.66 |
| Llama 3.3 | 18000 | off by ×1.06 |
| Qwen · off | 12500 | off by ×1.53 |
| Qwen · on | 1500 | off by ×12.73 |
test
dd-volume-v1-08005085-2025
In Dresden, for Käthe-Kollwitz-Ufer between ÖW 5 - Altstadt II and Fetscherstraße/Westrampe (counting station 08005085), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
14400| Model | Answer given | |
|---|---|---|
| Gemma 4 | 14500 | off by ×1.01 |
| Llama 3.3 | 25000 | off by ×1.74 |
| Qwen · off | {"value": 12500} | off by ×1.15 |
| Qwen · on | 18000 | off by ×1.25 |
test
dd-volume-v1-11265030-2025
In Dresden, for Michaelisstraße between Am Galgenberg and Dohnaer Str. (counting station 11265030), what was the daily motor-vehicle count reported by the city for the count on 20.03.2025, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
11100| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12500 | off by ×1.13 |
| Llama 3.3 | 1200 | off by ×9.25 |
| Qwen · off | {"value": 12500} | off by ×1.13 |
| Qwen · on | 3200 | off by ×3.47 |
test
dd-volume-v1-04061005-2025
In Dresden, for Moritzburger Landstraße between Neuländer Straße and OD-Ende/Station 3978 (counting station 04061005), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
13200| Model | Answer given | |
|---|---|---|
| Gemma 4 | 38500 | off by ×2.92 |
| Llama 3.3 | 30175 | off by ×2.29 |
| Qwen · off | {"value": 12500} | off by ×1.06 |
| Qwen · on | 21000 | off by ×1.59 |
test
dd-volume-v1-12055120-2023
In Dresden, for Nöthnitzer Straße between Zeunerstr./ÖFW and Bergstr. (counting station 12055120), what was the daily motor-vehicle count reported by the city for the count on 07.06.2023, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
6700| Model | Answer given | |
|---|---|---|
| Gemma 4 | 11500 | off by ×1.72 |
| Llama 3.3 | 8646 | off by ×1.29 |
| Qwen · off | {"value": 12500} | off by ×1.87 |
| Qwen · on | 10000 | off by ×1.49 |
test
dd-volume-v1-06161020-2025
In Dresden, for Radeberger Landstraße between Gänsefuß and Ullersdorf-Langebrücker Str. (counting station 06161020), what was the annual mean daily motor-vehicle volume for the year 2025, both directions combined? Measurement method: Pegelzählstelle (Induktionsschleifen), Jahresmittelwert. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
11000| Model | Answer given | |
|---|---|---|
| Gemma 4 | 14500 | off by ×1.32 |
| Llama 3.3 | 25000 | off by ×2.27 |
| Qwen · off | {"value": 12500} | off by ×1.14 |
| Qwen · on | 19000 | off by ×1.73 |
test
dd-volume-v1-07074020-2023
In Dresden, for Rochwitzer Straße between Bebauungsgrenze/HN 9 and Gönnsdorfer Str. (counting station 07074020), what was the daily motor-vehicle count reported by the city for the count on 14.09.2023, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
2300| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12500 | off by ×5.43 |
| Llama 3.3 | 18300 | off by ×7.96 |
| Qwen · off | {"value": 12500} | off by ×5.43 |
| Qwen · on | 14000 | off by ×6.09 |
test
dd-volume-v1-12180040-2025
In Dresden, for Stuttgarter Straße between Pforzheimer Str. and Tübinger Str. (counting station 12180040), what was the daily motor-vehicle count reported by the city for the count on 27.08.2025, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
8300| Model | Answer given | |
|---|---|---|
| Gemma 4 | 0 | ✗ unreadable |
| Llama 3.3 | 16300 | off by ×1.96 |
| Qwen · off | {"value": 12500} | off by ×1.51 |
| Qwen · on | 1500 | off by ×5.53 |
test
dd-volume-v1-00069030-2024
In Dresden, for Terrassenufer between ÖFW 29-Altstadt I and Steinstr. (counting station 00069030), what was the daily motor-vehicle count reported by the city for the count on 30.05.2024, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
21500| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12500 | off by ×1.72 |
| Llama 3.3 | {"vehicles_per_day": 30000} | off by ×1.40 |
| Qwen · off | {"value": 12500} | off by ×1.72 |
| Qwen · on | 10000 | off by ×2.15 |
test
dd-volume-v1-14044080-2024
In Dresden, for Wernerstraße between Gohliser Str. and Kesselsdorfer Str. (counting station 14044080), what was the daily motor-vehicle count reported by the city for the count on 10.09.2024, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
5800| Model | Answer given | |
|---|---|---|
| Gemma 4 | 850 | off by ×6.82 |
| Llama 3.3 | 1500 | off by ×3.87 |
| Qwen · off | {"value": 12500} | off by ×2.16 |
| Qwen · on | 800 | off by ×7.25 |
test
dd-volume-v1-03030050-2024
In Dresden, for Wurzener Straße between Dahlener Str. and Leipziger Str. (counting station 03030050), what was the daily motor-vehicle count reported by the city for the count on 30.05.2024, both directions combined? Measurement method: manuelle Zählung. Return one positive number in motor vehicles per day. Give your best estimate even if you are uncertain; an approximate answer is expected. Return only one positive JSON number (vehicles per day). Do not return null and do not add explanations or units.
Correct answer:
7500| Model | Answer given | |
|---|---|---|
| Gemma 4 | 12500 | off by ×1.67 |
| Llama 3.3 | 1500 | off by ×5.00 |
| Qwen · off | {"value": 12500} | off by ×1.67 |
| Qwen · on | 14000 | off by ×1.87 |