gpt-oss-20b:free

2026-05-14T15-54-01Z_openrouter_openai_gpt-oss-20b_free

Reference run: Codex CLI, OpenCode, or OpenRouter baseline, included as a comparison target rather than a local-model result.

pass Visual sample result

3/3 Automated checks

1/1 SVG artifact

Verdict

visual sample

pass

1 artifact · 3/3 checks · pass

no failure labels

Prompt set v1_city_plan_svg.json

Run type reference

Temperature 0

Top P 1

Missed tasks 0/1

SVG Artifacts

1 artifact · 3/3 checks · pass

city_plan_3d_buildings_svg 3/3 · v1_city_plan_svg.json open SVG

Task Results

Compact view; open a row for prompt and raw answer

Task	Category	Score	Failed Checks	Failure Types	Prompt / Answer
city_plan_3d_buildings_svg	svg	3/3	none	none	Open Prompt Generate a valid standalone SVG of a city plan with a 3D-style representation of buildings. Rules: - SVG only - no Markdown - no external images - no JavaScript - include roads or city blocks - include multiple buildings - make at least some buildings appear 3D or isometric - use simple vector shapes Model answer <svg width="800" height="600" viewBox="0 0 800 600" xmlns="http://www.w3.org/2000/svg"> <!-- Grid for city blocks --> <rect x="20" y="50" width="760" height="500" fill="#f0f0f0" stroke="#cccccc" stroke-width="2"/> <!-- Roads --> <rect x="20" y="200" width="760" height="20" fill="#777777"/> <rect x="20" y="350" width="760" height="20" fill="#777777"/> <rect x="200" y="50" width="20" height="500" fill="#777777"/> <rect x="600" y="50" width="20" height="500" fill="#777777"/> <!-- Building 1 : Simple rectangle --> <rect x="240" y="80" width="100" height="70" fill="#8fb3d7" stroke="#555555" stroke-width="1"/> <!-- Building 2 : 3D cuboid --> <polygon points="350,120 460,120 490,150 380,150" fill="#ffa07a" stroke="#993333" stroke-width="1"/> <polygon points="350,120 380,150 380,230 350,200" fill="#ff8c66" stroke="#993333" stroke-width="1"/> <polygon points="460,120 490,150 490,230 460,200" fill="#ff9966" stroke="#993333" stroke-width="1"/> <!-- Building 3 : Isometric prism --> <polygon points="520,170 580,170 590,190 530,190" fill="#d3d3d3" stroke="#999999" stroke-width="1"/> <polygon points="520,170 530,190 530,260 520,240" fill="#b8b8b8" stroke="#777777" stroke-width="1"/> <polygon points="580,170 590,190 590,260 580,240" fill="#a2a2a2" stroke="#666666" stroke-width="1"/> <!-- Building 4 : Skyline rectangle --> <rect x="650" y="80" width="120" height="140" fill="#90ee90" stroke="#556b2f" stroke-width="1"/> <!-- Building 5 : Small 3D tower --> <polygon points="120,250 180,250 190,260 130,260" fill="#add8e6" stroke="#4a769e" stroke-width="1"/> <polygon points="120,250 130,260 130,320 120,310" fill="#8c9ca6" stroke="#4a769e" stroke-width="1"/> <polygon points="180,250 190,260 190,320 180,310" fill="#7092a4" stroke="#4a769e" stroke-width="1"/> </svg>

Task

Category

Score

Failed Checks

Failure Types

Prompt / Answer

city_plan_3d_buildings_svg

svg

3/3

none

Open

Prompt

Generate a valid standalone SVG of a city plan with a 3D-style representation of buildings.

Rules:
- SVG only
- no Markdown
- no external images
- no JavaScript
- include roads or city blocks
- include multiple buildings
- make at least some buildings appear 3D or isometric
- use simple vector shapes

Model answer

<svg width="800" height="600" viewBox="0 0 800 600" xmlns="http://www.w3.org/2000/svg">
  <!-- Grid for city blocks -->
  <rect x="20" y="50" width="760" height="500" fill="#f0f0f0" stroke="#cccccc" stroke-width="2"/>
  <!-- Roads -->
  <rect x="20" y="200" width="760" height="20" fill="#777777"/>
  <rect x="20" y="350" width="760" height="20" fill="#777777"/>
  <rect x="200" y="50" width="20" height="500" fill="#777777"/>
  <rect x="600" y="50" width="20" height="500" fill="#777777"/>
  <!-- Building 1 : Simple rectangle -->
  <rect x="240" y="80" width="100" height="70" fill="#8fb3d7" stroke="#555555" stroke-width="1"/>
  <!-- Building 2 : 3D cuboid -->
  <polygon points="350,120 460,120 490,150 380,150" fill="#ffa07a" stroke="#993333" stroke-width="1"/>
  <polygon points="350,120 380,150 380,230 350,200" fill="#ff8c66" stroke="#993333" stroke-width="1"/>
  <polygon points="460,120 490,150 490,230 460,200" fill="#ff9966" stroke="#993333" stroke-width="1"/>
  <!-- Building 3 : Isometric prism -->
  <polygon points="520,170 580,170 590,190 530,190" fill="#d3d3d3" stroke="#999999" stroke-width="1"/>
  <polygon points="520,170 530,190 530,260 520,240" fill="#b8b8b8" stroke="#777777" stroke-width="1"/>
  <polygon points="580,170 590,190 590,260 580,240" fill="#a2a2a2" stroke="#666666" stroke-width="1"/>
  <!-- Building 4 : Skyline rectangle -->
  <rect x="650" y="80" width="120" height="140" fill="#90ee90" stroke="#556b2f" stroke-width="1"/>
  <!-- Building 5 : Small 3D tower -->
  <polygon points="120,250 180,250 190,260 130,260" fill="#add8e6" stroke="#4a769e" stroke-width="1"/>
  <polygon points="120,250 130,260 130,320 120,310" fill="#8c9ca6" stroke="#4a769e" stroke-width="1"/>
  <polygon points="180,250 190,260 190,320 180,310" fill="#7092a4" stroke="#4a769e" stroke-width="1"/>
</svg>