Spaces:
Running
Running
Download index.html from SimWorld-AI/Code4Scene: direct link, hf CLI and curl.
- Browser
- Download file 155 kB
-
https://huggingface.co/spaces/SimWorld-AI/Code4Scene/resolve/main/index.html
- Command line
-
hf download hf://spaces/SimWorld-AI/Code4Scene/index.html
-
curl -L -o index.html https://huggingface.co/spaces/SimWorld-AI/Code4Scene/resolve/main/index.html
155 kB
| <html lang="en"><head> | |
| <meta charset="utf-8"/><meta content="width=device-width,initial-scale=1" name="viewport"/> | |
| <title>Code4Scene: Benchmarking Coding Agents for Constructing 3D Scenes</title><meta content="A benchmark that scores the engine-native 3D scenes coding agents build in Unreal Engine from open-ended descriptions." name="description"/> | |
| <link href="assets/code4scene-mark.svg" rel="icon"/> | |
| <link href="assets/paper.css?v=5427505a" rel="stylesheet"/> | |
| <style> | |
| :root{--c4s-a:#5a67d8;--c4s-b:#d97706;--c4s-hot:#dc4a2d;--c4s-ok:#10A37F;--c4s-g1:#8b93a7;--c4s-g2:#aab1c2;--c4s-g3:#cdd2de;--c4s-seq:#5a67d8;--c4s-unit:#e3e7f0} | |
| svg.ch{width:100%;height:auto;display:block;font-family:Inter,system-ui,sans-serif;overflow:visible} | |
| svg.ch text{fill:var(--text-secondary);font-size:13px}svg.ch .b{fill:var(--text-primary);font-weight:700}svg.ch .m{fill:var(--text-muted);font-size:12px} | |
| svg.ch .num{font-variant-numeric:tabular-nums}svg.ch .grid{stroke:var(--line-soft);stroke-width:1}svg.ch .axis{stroke:var(--line-strong);stroke-width:1} | |
| svg.ch .dim{opacity:.42}svg.ch g.row:hover{opacity:1}svg.ch .hot{fill:var(--c4s-hot);font-weight:700} | |
| .ch-legend{display:flex;flex-wrap:wrap;gap:6px 18px;margin:0 0 10px;font-size:13px;color:var(--text-secondary)} | |
| .ch-legend span{display:inline-flex;align-items:center;gap:7px}.ch-legend i{width:12px;height:12px;border-radius:3px;display:inline-block} | |
| .ev{position:relative;border-radius:var(--radius-sm);overflow:hidden;border:1px solid var(--line-soft)}.ev img{display:block;width:100%} | |
| .ev svg{position:absolute;inset:0;width:100%;height:100%} | |
| .chips{display:flex;flex-wrap:wrap;gap:8px;margin-top:10px}.chip{font-size:13px;font-weight:600;padding:4px 10px;border-radius:999px;border:1px solid var(--line)} | |
| .chip.ok{color:var(--c4s-ok);border-color:currentColor}.chip.no{color:var(--c4s-hot);border-color:currentColor}.chip small{font-weight:500;color:var(--text-muted);margin-left:4px} | |
| .bigstats{display:flex;flex-wrap:wrap;gap:12px 34px;margin:0 0 12px}.bigstats b{display:block;font-size:30px;letter-spacing:-.02em;font-variant-numeric:tabular-nums} | |
| .bigstats span{font-size:13px;color:var(--text-secondary)} | |
| </style><link href="assets/buildingbench.css?v=20261004harborlive" rel="stylesheet"/><script type="importmap">{"imports":{"three":"./assets/vendor/three-r160/build/three.module.js","three/addons/":"./assets/vendor/three-r160/addons/"}}</script></head><body><a class="skip-link" href="#leaderboard">Skip to benchmark explorer</a> | |
| <header class="site-header"><div class="brand"><a aria-label="Code4Scene home" class="brand-home" href="index.html#top"><svg aria-hidden="true" fill="none" viewbox="0 0 30 32"><path d="M15 2 27 9v14l-12 7L3 23V9L15 2Z M3 9l12 7 12-7 M15 16v14 M9 5.5l12 7v14 M21 5.5l-12 7v14" stroke="currentColor" stroke-linejoin="round" stroke-width="1.6"></path></svg><span>Code4Scene</span></a><a class="brand-by" href="https://simworld.org/">by SimWorld</a></div><nav aria-label="Main navigation"><a class="nav-active" href="index.html#top">Benchmark</a><a href="index.html#leaderboard">Leaderboard</a><a href="index.html#cases">Visualization</a><a href="https://arxiv.org/abs/2609.36777" rel="noopener" target="_blank">Paper ↗</a><a href="https://github.com/SimWorld-AI/Code4Scene" rel="noopener" target="_blank">Github ↗</a></nav></header><main class="page-main"><section class="intro" id="top"><div class="intro-copy"><h1>Constructing<br/><em>3D Scenes with Code</em></h1><p class="intro-text">Benchmarking coding agents that turn open-ended scene descriptions into engine-native 3D scenes in Unreal Engine. Measuring spatial reasoning, task fulfillment and physical validity.</p><div class="intro-links"><a href="https://arxiv.org/abs/2609.36777">Read the paper ↗</a><a href="https://github.com/SimWorld-AI/Code4Scene">Code & Data ↗</a><a href="#hero-video">Watch the teaser ↘</a></div></div><div class="featured featured-video" id="hero-video"><video aria-label="Code4Scene overview video" controls="" playsinline="" poster="media/teaser-poster.jpg" preload="metadata"><source src="media/teaser-v31.mp4" type="video/mp4"/>Your browser does not support embedded video. <a href="media/teaser-v31.mp4">Watch the Code4Scene video</a>.</video><div class="featured-video-caption"><strong>Code4Scene in 90 seconds</strong><span>Construction and evaluation</span></div></div></section><section class="task-section" id="task-format"><div class="container"><h2 class="section-title">Task Format</h2><div class="task-shell"><div aria-label="Task format" class="task-tabs" role="tablist"><button aria-controls="task-t2s" aria-selected="true" data-task="t2s" id="task-tab-t2s" role="tab">Text-to-Scene</button><button aria-controls="task-i2s" aria-selected="false" data-task="i2s" id="task-tab-i2s" role="tab" tabindex="-1">Image-to-Scene</button></div><div aria-labelledby="task-tab-t2s" class="task-content" data-task="t2s" id="task-t2s" role="tabpanel"><h3>Nordic Harbour <span>· Text-to-Scene</span></h3><p class="task-subtitle">An open-ended scene description, an asset catalog and the Unreal Engine editor.</p><div class="task-columns"><article class="task-panel"><div class="panel-heading"><strong>Agent input</strong><span>Text + assets</span></div><div class="prompt-preview"><span class="eyebrow">Task instruction</span><p>Build me a compact, sunlit Copenhagen-style canal district with narrow cobblestone streets and rectangular waterways enclosing dense urban blocks.</p><p class="prompt-detail">Townhouses, canals, bridges and a waterfront promenade — with detailed requirements for materials, layout and street furniture.</p></div><p class="task-foot"><strong>Given:</strong> an empty level and the content pack’s asset catalog.</p></article><article class="task-panel output-panel"><div class="panel-heading"><strong>Agent output</strong><span>GPT-6 Astra</span></div><div class="live-scene" data-agent="astra" data-case="nordic-harbour"><canvas aria-label="Interactive 3D scene: Nordic Harbour. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><a class="task-foot text-button" href="cases.html#nordic-harbour">Compare agents and evaluator views ↗</a></article><article class="task-panel evaluation-panel"><div class="panel-heading"><strong>Evaluation</strong><span>Engine-native scene</span></div><div class="score-block"><span>CASE SCORE</span><strong>0.877</strong><dl><div><dt>Detailed Alignment</dt><dd>0.757</dd></div><div><dt>Overview Alignment</dt><dd>0.909</dd></div><div><dt>Physical Safety</dt><dd>0.900</dd></div></dl></div><p class="task-foot">Task fulfillment, artifact integrity and static physical validity.</p><p class="task-formula">0.2 × Detailed + 0.6 × Overview + 0.2 × Physical</p></article></div><details class="task-full"><summary><span>+ Full task instruction</span><span>TEXT-TO-SCENE</span></summary><p>Build me a compact, sunlit Copenhagen-style canal district with narrow cobblestone streets and rectangular waterways enclosing dense urban blocks. Arrange roughly thirty attached four- to six-storey townhouses in continuous street and canal-front rows, using slender façades, repetitive white-framed windows, arched doors and carriage entrances, modest cornices, and steep tiled roofs packed with dormers and brick chimneys. Include occasional exposed party walls between staggered building rows. Finish the façades in weathered muted red, mustard yellow, dusty blue, warm grey, beige, and exposed brick, with red, orange, and charcoal roof tiles. Run a principal waterfront street along a stone quay, crossed by smaller streets and linked across the canals by short, gently arched stone-and-metal bridges, including one opening onto a broad paved promenade with rounded landings. Form the canal edges from stepped pale stone, dark timber retaining walls, and iron railings around reflective rippling water. Add regularly spaced leafy trees, ornate black lamps, stone bollards, benches, European road signs, zebra crossings, puddles, grime, and sparse weeds.</p></details><div class="availability"><span><b>20</b> scenes in the <strong>Research Track</strong>: affordable, reproducible evaluation for academic and model-development use</span><span><b>160</b> scenes in the <strong>Full Benchmark</strong>: comprehensive evaluation for leaderboard and final reporting</span></div></div><div aria-labelledby="task-tab-i2s" class="task-content" data-task="i2s" hidden="" id="task-i2s" role="tabpanel"><h3>Old Industrial Pallet Bay <span>· Image-to-Scene</span></h3><p class="task-subtitle">Repair the corrupted scene using its reference image; preserve all unrelated actors.</p><div class="task-columns"><article class="task-panel input-panel"><div class="panel-heading"><strong>Agent input</strong><span>Scene + reference image</span></div><div class="live-scene" data-agent="astra" data-case="comp-31-old-industrial-pallet-bay-repair-v2" data-state="input"><canvas aria-label="Interactive 3D: Old Industrial Pallet Bay, input. Drag to orbit; scroll to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Resume scene rotation" class="scene-motion">▶</button></div><a class="task-reference" href="media/i2s/comp-31-old-industrial-pallet-bay-repair-v2/ref-1.jpg?v=1790549706" rel="noopener" target="_blank"><img alt="Provided reference image for Old Industrial Pallet Bay" loading="lazy" src="media/i2s/comp-31-old-industrial-pallet-bay-repair-v2/ref-1.jpg?v=1790549706"/><span>Provided reference image ↗</span></a><p class="task-foot">A translated and rotated pallet stack, plus an unintended duplicate.</p></article><article class="task-panel output-panel"><div class="panel-heading"><strong>Agent output</strong><span>GPT-6 Astra</span></div><div class="live-scene" data-agent="astra" data-case="comp-31-old-industrial-pallet-bay-repair-v2" data-state="repair"><canvas aria-label="Interactive 3D: Old Industrial Pallet Bay, repair. Drag to orbit; scroll to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Resume scene rotation" class="scene-motion">▶</button></div><div aria-label="Output scene state" class="scene-versions"><button class="on" data-state="repair">Repair</button><button data-state="input">Corrupted input</button><button data-state="gt">Ground truth</button></div><p class="task-foot">Inspect the saved repair from the same reference camera.</p><a class="text-button task-foot" href="cases.html#comp-31-old-industrial-pallet-bay-repair-v2">Compare agents and evaluator views ↗</a></article><article class="task-panel evaluation-panel"><div class="panel-heading"><strong>Evaluation</strong><span>Actor-level repair</span></div><div class="score-block"><span>CASE SCORE</span><strong>1.000</strong><dl><div><dt>Repair F1</dt><dd>1.000</dd></div><div><dt>Physical Safety</dt><dd>1.000</dd></div><div><dt>TP / FP / FN</dt><dd>2 / 0 / 0</dd></div></dl></div><p class="task-foot">Restore each target within 5 cm, 5° and 5%, without unintended edits.</p><p class="task-formula">0.8 × Repair F1 + 0.2 × Physical</p></article></div><details class="task-full"><summary><span>+ Full task instruction</span><span>IMAGE-TO-SCENE</span></summary><p>Repair the current outdoor scene so it matches the provided reference image. Make only the minimum changes needed, and preserve all unrelated actors and properties.</p></details><div class="availability"><span><b>160</b> editing cases in the full benchmark target, including private cases</span><span><b>72</b> public editing cases (22 indoor, 50 outdoor)</span></div></div></div></div></section><section id="leaderboard"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Leaderboard</span><h2 class="section-title">Leaderboard</h2> | |
| <p class="section-desc" data-view="t2s">Research Track · 20 representative scenes · 14 coding-agent configurations.</p><p class="section-desc" data-view="i2s" style="display:none">Image-to-Scene · 75 public cases (25 indoor, 50 outdoor) · 14 coding-agent configurations.</p><p class="tracks-why" data-view="t2s">Text-to-scene generation with frontier models is a long-horizon agentic task with substantial inference cost and runtime, which makes repeated full-scale evaluation difficult for many research groups. The Research Track supports affordable, reproducible experimentation; the Full Benchmark provides the more comprehensive evaluation for final model comparison and leaderboard reporting.</p></div> | |
| <div id="lbwrap"><div class="lb-tabs"><div class="seg seg-lg" data-for="leaderboard"><button class="on" data-view="t2s">Text-to-Scene</button><button data-view="i2s">Image-to-Scene</button></div></div><div class="card bar-card"><div class="bar-heading"><h3>Code4Scene <span class="q" data-view="t2s">Research Track</span><span class="q" data-view="i2s" style="display:none">Image-to-Scene</span></h3><span><span data-view="t2s">20 scenes · score out of 100</span><span data-view="i2s" style="display:none">75 scenes · score out of 100</span></span></div><p class="bar-mobile-hint">Swipe to view all 14 configurations →</p><div aria-label="All 14 model configurations" class="bar-scroll" role="region" tabindex="0"><div data-view="t2s"><svg aria-label="Research Track scores for the 14 Code4Scene configurations" class="kit-bars" id="bars-t2s" role="group" viewbox="0 0 1200 420"></svg></div><div data-view="i2s" style="display:none"><svg aria-label="Image-to-Scene scores for the 14 Code4Scene paper configurations" class="kit-bars" id="bars-i2s" role="group" viewbox="0 0 1200 420"></svg></div></div><p class="note">Sorted by score. Bar labels round scores ×100; the table preserves three decimal places. One color per model provider.</p></div> | |
| <div class="card chart-card pareto-card"><h3 class="figure-title">Code4Scene <span>Pareto Frontier</span></h3><p class="figure-subtitle" data-view="t2s">Quality against the cost of one case · Research Track, 20 scenes</p><p class="figure-subtitle" data-view="i2s" style="display:none">Quality against the cost of one case · Image-to-Scene, 75 public cases</p><p class="pareto-swipe">Swipe to explore all configurations →</p><div class="pareto-view" data-view="t2s"><div class="pareto-scroll"><svg aria-label="t2s score against average cost per case. More expensive runs on the left; logarithmic scale." class="pareto-svg" data-mode="t2s" role="group" viewbox="0 0 1200 560"></svg></div></div><div class="pareto-view" data-view="i2s" style="display:none"><div class="pareto-scroll"><svg aria-label="i2s score against average cost per case. More expensive runs on the left; logarithmic scale." class="pareto-svg" data-mode="i2s" role="group" viewbox="0 0 1200 560"></svg></div></div><p class="figure-caption">Solid: the frontier — nothing cheaper scores higher. One point per configuration, at its evaluated reasoning effort. Cost is the mean USD per case.</p></div> | |
| <div class="card ranking-card"><div class="ranking-toolbar"><label for="model-search">Search configurations<input autocomplete="off" id="model-search" placeholder="Model or provider" type="search"/></label><span aria-live="polite" id="ranking-count">14 configurations</span></div><div class="sub-title">Ranking</div><div data-view="t2s"><p class="board-note" style="margin:0 .2rem .7rem">Research Track, 20 scenes. Case score = 0.2 × Detailed + 0.6 × Overview + 0.2 × Physical. Detailed and Overview are means of the per-case scores.</p><div class="board-wrap"><table class="board"><thead><tr><th>#</th><th>Agent configuration</th><th class="sorted" data-best="high" data-k="st">Score</th><th data-best="high" data-k="detailed">Detailed</th><th data-best="high" data-k="overview">Overview</th><th data-best="high" data-k="pt">Physical</th><th data-best="low" data-k="c_t2s">Cost / case</th></tr></thead><tbody><tr data-model-key="fable" data-search="claude fable 5.1 (max) anthropic"><td class="rk">1</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Fable 5.1 (max)<span class="tag front">Pareto</span><span class="org">Anthropic</span></td><td data-v="0.78775"><div class="cellbar"><i style="width:80.0px;--bar:var(--c4s-a)"></i><b>0.788</b></div></td><td class="dim" data-v="0.7253149999999999">0.725</td><td class="dim" data-v="0.7717050000000001">0.772</td><td class="dim" data-v="0.898">0.898</td><td class="dim" data-v="18.1576316">$18.16</td></tr><tr data-model-key="astra" data-search="gpt-6 astra (max) openai"><td class="rk">2</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-6 Astra (max)<span class="org">OpenAI</span></td><td data-v="0.72382"><div class="cellbar"><i style="width:73.5px;--bar:var(--c4s-a)"></i><b>0.724</b></div></td><td class="dim" data-v="0.707165">0.707</td><td class="dim" data-v="0.733235">0.733</td><td class="dim" data-v="0.712">0.712</td><td class="dim" data-v="22.472260736842106">$22.47</td></tr><tr data-model-key="opus" data-search="claude opus 5 (max) anthropic"><td class="rk">3</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Opus 5 (max)<span class="org">Anthropic</span></td><td data-v="0.7181599999999999"><div class="cellbar"><i style="width:72.9px;--bar:var(--c4s-a)"></i><b>0.718</b></div></td><td class="dim" data-v="0.63106">0.631</td><td class="dim" data-v="0.71617">0.716</td><td class="dim" data-v="0.811">0.811</td><td class="dim" data-v="34.49611078947368">$34.50</td></tr><tr data-model-key="sol" data-search="gpt-5.6 sol (high) openai"><td class="rk">4</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-5.6 Sol (high)<span class="tag front">Pareto</span><span class="org">OpenAI</span></td><td data-v="0.70704"><div class="cellbar"><i style="width:71.8px;--bar:var(--c4s-a)"></i><b>0.707</b></div></td><td class="dim" data-v="0.63186">0.632</td><td class="dim" data-v="0.710485">0.710</td><td class="dim" data-v="0.772">0.772</td><td class="dim" data-v="4.07260365">$4.07</td></tr><tr data-model-key="gemini" data-search="gemini 3.8 flash (high) google"><td class="rk">5</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-19)" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><lineargradient id="c4sGem-19" x1="0" x2="1" y1="0" y2="1"><stop offset="0" stop-color="#4796E3"></stop><stop offset=".55" stop-color="#9168C0"></stop><stop offset="1" stop-color="#D96570"></stop></lineargradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemini 3.8 Flash (high)<span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.65689"><div class="cellbar"><i style="width:66.7px;--bar:var(--c4s-a)"></i><b>0.657</b></div></td><td class="dim" data-v="0.6369100000000001">0.637</td><td class="dim" data-v="0.66406">0.664</td><td class="dim" data-v="0.655">0.655</td><td class="dim" data-v="2.49471265">$2.49</td></tr><tr data-model-key="muse" data-search="muse spark 1.3 (medium) meta"><td class="rk">6</td><td class="nm"><span class="logo"><svg fill="#0081FB" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Meta</title><path d="M6.897 4c1.915 0 3.516.932 5.43 3.376l.282-.373c.19-.246.383-.484.58-.71l.313-.35C14.588 4.788 15.792 4 17.225 4c1.273 0 2.469.557 3.491 1.516l.218.213c1.73 1.765 2.917 4.71 3.053 8.026l.011.392.002.25c0 1.501-.28 2.759-.818 3.7l-.14.23-.108.153c-.301.42-.664.758-1.086 1.009l-.265.142-.087.04a3.493 3.493 0 01-.302.118 4.117 4.117 0 01-1.33.208c-.524 0-.996-.067-1.438-.215-.614-.204-1.163-.56-1.726-1.116l-.227-.235c-.753-.812-1.534-1.976-2.493-3.586l-1.43-2.41-.544-.895-1.766 3.13-.343.592C7.597 19.156 6.227 20 4.356 20c-1.21 0-2.205-.42-2.936-1.182l-.168-.184c-.484-.573-.837-1.311-1.043-2.189l-.067-.32a8.69 8.69 0 01-.136-1.288L0 14.468c.002-.745.06-1.49.174-2.23l.1-.573c.298-1.53.828-2.958 1.536-4.157l.209-.34c1.177-1.83 2.789-3.053 4.615-3.16L6.897 4zm-.033 2.615l-.201.01c-.83.083-1.606.673-2.252 1.577l-.138.199-.01.018c-.67 1.017-1.185 2.378-1.456 3.845l-.004.022a12.591 12.591 0 00-.207 2.254l.002.188c.004.18.017.36.04.54l.043.291c.092.503.257.908.486 1.208l.117.137c.303.323.698.492 1.17.492 1.1 0 1.796-.676 3.696-3.641l2.175-3.4.454-.701-.139-.198C9.11 7.3 8.084 6.616 6.864 6.616zm10.196-.552l-.176.007c-.635.048-1.223.359-1.82.933l-.196.198c-.439.462-.887 1.064-1.367 1.807l.266.398c.18.274.362.56.55.858l.293.475 1.396 2.335.695 1.114c.583.926 1.03 1.6 1.408 2.082l.213.262c.282.326.529.54.777.673l.102.05c.227.1.457.138.718.138.176.002.35-.023.518-.073.338-.104.61-.32.813-.637l.095-.163.077-.162c.194-.459.29-1.06.29-1.785l-.006-.449c-.08-2.871-.938-5.372-2.2-6.798l-.176-.189c-.67-.683-1.444-1.074-2.27-1.074z"></path></svg></span>Muse Spark 1.3 (medium)<span class="tag front">Pareto</span><span class="org">Meta</span></td><td data-v="0.646195"><div class="cellbar"><i style="width:65.6px;--bar:var(--c4s-a)"></i><b>0.646</b></div></td><td class="dim" data-v="0.5981099999999999">0.598</td><td class="dim" data-v="0.660675">0.661</td><td class="dim" data-v="0.651">0.651</td><td class="dim" data-v="0.10048539999999999">$0.10</td></tr><tr data-model-key="grok" data-search="grok 4.6 (high) xai"><td class="rk">7</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grok</title><path d="M9.27 15.29l7.978-5.897c.391-.29.95-.177 1.137.272.98 2.369.542 5.215-1.41 7.169-1.951 1.954-4.667 2.382-7.149 1.406l-2.711 1.257c3.889 2.661 8.611 2.003 11.562-.953 2.341-2.344 3.066-5.539 2.388-8.42l.006.007c-.983-4.232.242-5.924 2.75-9.383.06-.082.12-.164.179-.248l-3.301 3.305v-.01L9.267 15.292M7.623 16.723c-2.792-2.67-2.31-6.801.071-9.184 1.761-1.763 4.647-2.483 7.166-1.425l2.705-1.25a7.808 7.808 0 00-1.829-1A8.975 8.975 0 005.984 5.83c-2.533 2.536-3.33 6.436-1.962 9.764 1.022 2.487-.653 4.246-2.34 6.022-.599.63-1.199 1.259-1.682 1.925l7.62-6.815"></path></svg></span>Grok 4.6 (high)<span class="org">xAI</span></td><td data-v="0.56721"><div class="cellbar"><i style="width:57.6px;--bar:var(--c4s-a)"></i><b>0.567</b></div></td><td class="dim" data-v="0.52211">0.522</td><td class="dim" data-v="0.5764199999999999">0.576</td><td class="dim" data-v="0.585">0.585</td><td class="dim" data-v="4.326270533333333">$4.33</td></tr><tr data-model-key="qwen-off" data-search="qwen 3.8 27b (thinking off) alibaba"><td class="rk">8</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking off)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.55666"><div class="cellbar"><i style="width:56.5px;--bar:var(--c4s-a)"></i><b>0.557</b></div></td><td class="dim" data-v="0.506755">0.507</td><td class="dim" data-v="0.529525">0.530</td><td class="dim" data-v="0.688">0.688</td><td class="dim" data-v="0.49154169999999997">$0.49</td></tr><tr data-model-key="qwen-on" data-search="qwen 3.8 27b (thinking on) alibaba"><td class="rk">9</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking on)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.51571"><div class="cellbar"><i style="width:52.4px;--bar:var(--c4s-a)"></i><b>0.516</b></div></td><td class="dim" data-v="0.50522">0.505</td><td class="dim" data-v="0.45978">0.460</td><td class="dim" data-v="0.694">0.694</td><td class="dim" data-v="0.3344125">$0.33</td></tr><tr data-model-key="glm" data-search="glm-5.3 flash (max) z.ai"><td class="rk">10</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Z.ai</title><path d="M12.105 2L9.927 4.953H.653L2.83 2h9.276zM23.254 19.048L21.078 22h-9.242l2.174-2.952h9.244zM24 2L9.264 22H0L14.736 2H24z"></path></svg></span>GLM-5.3 Flash (max)<span class="tag open">open weights</span><span class="org">Z.ai</span></td><td data-v="0.5094299999999999"><div class="cellbar"><i style="width:51.7px;--bar:var(--c4s-a)"></i><b>0.509</b></div></td><td class="dim" data-v="0.403365">0.403</td><td class="dim" data-v="0.537015">0.537</td><td class="dim" data-v="0.533">0.533</td><td class="dim" data-v="0.710521125">$0.71</td></tr><tr data-model-key="gemma-on" data-search="gemma 4 31b (thinking on) google"><td class="rk">11</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-25)" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><lineargradient id="c4sGem-25" x1="0" x2="1" y1="0" y2="1"><stop offset="0" stop-color="#4796E3"></stop><stop offset=".55" stop-color="#9168C0"></stop><stop offset="1" stop-color="#D96570"></stop></lineargradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking on)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.470705"><div class="cellbar"><i style="width:47.8px;--bar:var(--c4s-a)"></i><b>0.471</b></div></td><td class="dim" data-v="0.4117">0.412</td><td class="dim" data-v="0.41593">0.416</td><td class="dim" data-v="0.694">0.694</td><td class="dim" data-v="0.0253001">$0.03</td></tr><tr data-model-key="gemma-off" data-search="gemma 4 31b (thinking off) google"><td class="rk">12</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-26)" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><lineargradient id="c4sGem-26" x1="0" x2="1" y1="0" y2="1"><stop offset="0" stop-color="#4796E3"></stop><stop offset=".55" stop-color="#9168C0"></stop><stop offset="1" stop-color="#D96570"></stop></lineargradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking off)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.45494"><div class="cellbar"><i style="width:46.2px;--bar:var(--c4s-a)"></i><b>0.455</b></div></td><td class="dim" data-v="0.43810000000000004">0.438</td><td class="dim" data-v="0.370465">0.370</td><td class="dim" data-v="0.725">0.725</td><td class="dim" data-v="0.0151612">$0.02</td></tr><tr data-model-key="inkling" data-search="inkling (high) thinking machines"><td class="rk">13</td><td class="nm"><span class="logo"><svg fill="currentColor" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Thinking Machines</title><rect height="15.6" rx="3.6" width="15.6" x="4.2" y="4.2"></rect></svg> | |
| </span>Inkling (high)<span class="org">Thinking Machines</span></td><td data-v="0.42498500000000006"><div class="cellbar"><i style="width:43.1px;--bar:var(--c4s-a)"></i><b>0.425</b></div></td><td class="dim" data-v="0.392605">0.393</td><td class="dim" data-v="0.336705">0.337</td><td class="dim" data-v="0.722">0.722</td><td class="dim" data-v="0.20252835">$0.20</td></tr><tr data-model-key="deepseek" data-search="deepseek v4.1 flash (high) deepseek"><td class="rk">14</td><td class="nm"><span class="logo"><svg fill="#4D6BFE" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>DeepSeek</title><path d="M23.748 4.482c-.254-.124-.364.113-.512.234-.051.039-.094.09-.137.136-.372.397-.806.657-1.373.626-.829-.046-1.537.214-2.163.848-.133-.782-.575-1.248-1.247-1.548-.352-.156-.708-.311-.955-.65-.172-.241-.219-.51-.305-.774-.055-.16-.11-.323-.293-.35-.2-.031-.278.136-.356.276-.313.572-.434 1.202-.422 1.84.027 1.436.633 2.58 1.838 3.393.137.093.172.187.129.323-.082.28-.18.552-.266.833-.055.179-.137.217-.329.14a5.526 5.526 0 01-1.736-1.18c-.857-.828-1.631-1.742-2.597-2.458a11.365 11.365 0 00-.689-.471c-.985-.957.13-1.743.388-1.836.27-.098.093-.432-.779-.428-.872.004-1.67.295-2.687.684a3.055 3.055 0 01-.465.137 9.597 9.597 0 00-2.883-.102c-1.885.21-3.39 1.102-4.497 2.623C.082 8.606-.231 10.684.152 12.85c.403 2.284 1.569 4.175 3.36 5.653 1.858 1.533 3.997 2.284 6.438 2.14 1.482-.085 3.133-.284 4.994-1.86.47.234.962.327 1.78.397.63.059 1.236-.03 1.705-.128.735-.156.684-.837.419-.961-2.155-1.004-1.682-.595-2.113-.926 1.096-1.296 2.746-2.642 3.392-7.003.05-.347.007-.565 0-.845-.004-.17.035-.237.23-.256a4.173 4.173 0 001.545-.475c1.396-.763 1.96-2.015 2.093-3.517.02-.23-.004-.467-.247-.588zM11.581 18c-2.089-1.642-3.102-2.183-3.52-2.16-.392.024-.321.471-.235.763.09.288.207.486.371.739.114.167.192.416-.113.603-.673.416-1.842-.14-1.897-.167-1.361-.802-2.5-1.86-3.301-3.307-.774-1.393-1.224-2.887-1.298-4.482-.02-.386.093-.522.477-.592a4.696 4.696 0 011.529-.039c2.132.312 3.946 1.265 5.468 2.774.868.86 1.525 1.887 2.202 2.891.72 1.066 1.494 2.082 2.48 2.914.348.292.625.514.891.677-.802.09-2.14.11-3.054-.614zm1-6.44a.306.306 0 01.415-.287.302.302 0 01.2.288.306.306 0 01-.31.307.303.303 0 01-.304-.308zm3.11 1.596c-.2.081-.399.151-.59.16a1.245 1.245 0 01-.798-.254c-.274-.23-.47-.358-.552-.758a1.73 1.73 0 01.016-.588c.07-.327-.008-.537-.239-.727-.187-.156-.426-.199-.688-.199a.559.559 0 01-.254-.078c-.11-.054-.2-.19-.114-.358.028-.054.16-.186.192-.21.356-.202.767-.136 1.146.016.352.144.618.408 1.001.782.391.451.462.576.685.914.176.265.336.537.445.848.067.195-.019.354-.25.452z"></path></svg></span>DeepSeek V4.1 Flash (high)<span class="tag open">open weights</span><span class="org">DeepSeek</span></td><td data-v="0.24269"><div class="cellbar"><i style="width:24.7px;--bar:var(--c4s-a)"></i><b>0.243</b></div></td><td class="dim" data-v="0.216595">0.217</td><td class="dim" data-v="0.16134500000000002">0.161</td><td class="dim" data-v="0.513">0.513</td><td class="dim" data-v="0.193865">$0.19</td></tr></tbody></table></div></div><div data-view="i2s" style="display:none"><p class="board-note" style="margin:0 .2rem .7rem">75 public cases (25 indoor, 50 outdoor). Case score = 0.8 × Repair F1 + 0.2 × Physical. Repair F1 counts target actors restored to the withheld ground truth.</p><div class="board-wrap"><table class="board"><thead><tr><th>#</th><th>Agent configuration</th><th class="sorted" data-best="high" data-k="si">Score</th><th data-best="high" data-k="f1">Repair F1</th><th data-best="high" data-k="pi">Physical</th><th data-best="high" data-k="indoor">Indoor</th><th data-best="high" data-k="outdoor">Outdoor</th><th data-best="low" data-k="c_i2s">Cost / case</th></tr></thead><tbody><tr data-model-key="gemini" data-search="gemini 3.8 flash (high) google"><td class="rk">1</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-29)" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><lineargradient id="c4sGem-29" x1="0" x2="1" y1="0" y2="1"><stop offset="0" stop-color="#4796E3"></stop><stop offset=".55" stop-color="#9168C0"></stop><stop offset="1" stop-color="#D96570"></stop></lineargradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemini 3.8 Flash (high)<span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.5810600533333334"><div class="cellbar"><i style="width:80.0px;--bar:var(--c4s-b)"></i><b>0.581</b></div></td><td class="dim" data-v="0.527">0.527</td><td class="dim" data-v="0.796">0.796</td><td class="dim" data-v="0.71653332">0.717</td><td class="dim" data-v="0.5133234200000001">0.513</td><td class="dim" data-v="1.3523245042517007">$1.35</td></tr><tr data-model-key="astra" data-search="gpt-6 astra (max) openai"><td class="rk">2</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-6 Astra (max)<span class="org">OpenAI</span></td><td data-v="0.5148505733333334"><div class="cellbar"><i style="width:70.9px;--bar:var(--c4s-b)"></i><b>0.515</b></div></td><td class="dim" data-v="0.445">0.445</td><td class="dim" data-v="0.796">0.796</td><td class="dim" data-v="0.78546656">0.785</td><td class="dim" data-v="0.37954258">0.380</td><td class="dim" data-v="3.3217229090909095">$3.32</td></tr><tr data-model-key="opus" data-search="claude opus 5 (max) anthropic"><td class="rk">3</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Opus 5 (max)<span class="org">Anthropic</span></td><td data-v="0.46809998666666675"><div class="cellbar"><i style="width:64.4px;--bar:var(--c4s-b)"></i><b>0.468</b></div></td><td class="dim" data-v="0.389">0.389</td><td class="dim" data-v="0.786">0.786</td><td class="dim" data-v="0.61843384">0.618</td><td class="dim" data-v="0.39293306">0.393</td><td class="dim" data-v="4.459671546394558">$4.46</td></tr><tr data-model-key="fable" data-search="claude fable 5.1 (max) anthropic"><td class="rk">4</td><td class="nm"><span class="logo"><svg fill="#D97757" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Claude</title><path d="M4.709 15.955l4.72-2.647.08-.23-.08-.128H9.2l-.79-.048-2.698-.073-2.339-.097-2.266-.122-.571-.121L0 11.784l.055-.352.48-.321.686.06 1.52.103 2.278.158 1.652.097 2.449.255h.389l.055-.157-.134-.098-.103-.097-2.358-1.596-2.552-1.688-1.336-.972-.724-.491-.364-.462-.158-1.008.656-.722.881.06.225.061.893.686 1.908 1.476 2.491 1.833.365.304.145-.103.019-.073-.164-.274-1.355-2.446-1.446-2.49-.644-1.032-.17-.619a2.97 2.97 0 01-.104-.729L6.283.134 6.696 0l.996.134.42.364.62 1.414 1.002 2.229 1.555 3.03.456.898.243.832.091.255h.158V9.01l.128-1.706.237-2.095.23-2.695.08-.76.376-.91.747-.492.584.28.48.685-.067.444-.286 1.851-.559 2.903-.364 1.942h.212l.243-.242.985-1.306 1.652-2.064.73-.82.85-.904.547-.431h1.033l.76 1.129-.34 1.166-1.064 1.347-.881 1.142-1.264 1.7-.79 1.36.073.11.188-.02 2.856-.606 1.543-.28 1.841-.315.833.388.091.395-.328.807-1.969.486-2.309.462-3.439.813-.042.03.049.061 1.549.146.662.036h1.622l3.02.225.79.522.474.638-.079.485-1.215.62-1.64-.389-3.829-.91-1.312-.329h-.182v.11l1.093 1.068 2.006 1.81 2.509 2.33.127.578-.322.455-.34-.049-2.205-1.657-.851-.747-1.926-1.62h-.128v.17l.444.649 2.345 3.521.122 1.08-.17.353-.608.213-.668-.122-1.374-1.925-1.415-2.167-1.143-1.943-.14.08-.674 7.254-.316.37-.729.28-.607-.461-.322-.747.322-1.476.389-1.924.315-1.53.286-1.9.17-.632-.012-.042-.14.018-1.434 1.967-2.18 2.945-1.726 1.845-.414.164-.717-.37.067-.662.401-.589 2.388-3.036 1.44-1.882.93-1.086-.006-.158h-.055L4.132 18.56l-1.13.146-.487-.456.061-.746.231-.243 1.908-1.312-.006.006z"></path></svg></span>Claude Fable 5.1 (max)<span class="org">Anthropic</span></td><td data-v="0.4243479600000001"><div class="cellbar"><i style="width:58.4px;--bar:var(--c4s-b)"></i><b>0.424</b></div></td><td class="dim" data-v="0.332">0.332</td><td class="dim" data-v="0.795">0.795</td><td class="dim" data-v="0.53523332">0.535</td><td class="dim" data-v="0.36890528000000006">0.369</td><td class="dim" data-v="3.0888859328063245">$3.09</td></tr><tr data-model-key="sol" data-search="gpt-5.6 sol (high) openai"><td class="rk">5</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg></span>GPT-5.6 Sol (high)<span class="org">OpenAI</span></td><td data-v="0.3929589333333333"><div class="cellbar"><i style="width:54.1px;--bar:var(--c4s-b)"></i><b>0.393</b></div></td><td class="dim" data-v="0.319">0.319</td><td class="dim" data-v="0.689">0.689</td><td class="dim" data-v="0.49742972">0.497</td><td class="dim" data-v="0.34072354">0.341</td><td class="dim" data-v="1.8773877185185188">$1.88</td></tr><tr data-model-key="muse" data-search="muse spark 1.3 (medium) meta"><td class="rk">6</td><td class="nm"><span class="logo"><svg fill="#0081FB" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Meta</title><path d="M6.897 4c1.915 0 3.516.932 5.43 3.376l.282-.373c.19-.246.383-.484.58-.71l.313-.35C14.588 4.788 15.792 4 17.225 4c1.273 0 2.469.557 3.491 1.516l.218.213c1.73 1.765 2.917 4.71 3.053 8.026l.011.392.002.25c0 1.501-.28 2.759-.818 3.7l-.14.23-.108.153c-.301.42-.664.758-1.086 1.009l-.265.142-.087.04a3.493 3.493 0 01-.302.118 4.117 4.117 0 01-1.33.208c-.524 0-.996-.067-1.438-.215-.614-.204-1.163-.56-1.726-1.116l-.227-.235c-.753-.812-1.534-1.976-2.493-3.586l-1.43-2.41-.544-.895-1.766 3.13-.343.592C7.597 19.156 6.227 20 4.356 20c-1.21 0-2.205-.42-2.936-1.182l-.168-.184c-.484-.573-.837-1.311-1.043-2.189l-.067-.32a8.69 8.69 0 01-.136-1.288L0 14.468c.002-.745.06-1.49.174-2.23l.1-.573c.298-1.53.828-2.958 1.536-4.157l.209-.34c1.177-1.83 2.789-3.053 4.615-3.16L6.897 4zm-.033 2.615l-.201.01c-.83.083-1.606.673-2.252 1.577l-.138.199-.01.018c-.67 1.017-1.185 2.378-1.456 3.845l-.004.022a12.591 12.591 0 00-.207 2.254l.002.188c.004.18.017.36.04.54l.043.291c.092.503.257.908.486 1.208l.117.137c.303.323.698.492 1.17.492 1.1 0 1.796-.676 3.696-3.641l2.175-3.4.454-.701-.139-.198C9.11 7.3 8.084 6.616 6.864 6.616zm10.196-.552l-.176.007c-.635.048-1.223.359-1.82.933l-.196.198c-.439.462-.887 1.064-1.367 1.807l.266.398c.18.274.362.56.55.858l.293.475 1.396 2.335.695 1.114c.583.926 1.03 1.6 1.408 2.082l.213.262c.282.326.529.54.777.673l.102.05c.227.1.457.138.718.138.176.002.35-.023.518-.073.338-.104.61-.32.813-.637l.095-.163.077-.162c.194-.459.29-1.06.29-1.785l-.006-.449c-.08-2.871-.938-5.372-2.2-6.798l-.176-.189c-.67-.683-1.444-1.074-2.27-1.074z"></path></svg></span>Muse Spark 1.3 (medium)<span class="tag front">Pareto</span><span class="org">Meta</span></td><td data-v="0.35821573333333334"><div class="cellbar"><i style="width:49.3px;--bar:var(--c4s-b)"></i><b>0.358</b></div></td><td class="dim" data-v="0.246">0.246</td><td class="dim" data-v="0.807">0.807</td><td class="dim" data-v="0.63253332">0.633</td><td class="dim" data-v="0.22105694">0.221</td><td class="dim" data-v="0.07172788461538461">$0.07</td></tr><tr data-model-key="glm" data-search="glm-5.3 flash (max) z.ai"><td class="rk">7</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Z.ai</title><path d="M12.105 2L9.927 4.953H.653L2.83 2h9.276zM23.254 19.048L21.078 22h-9.242l2.174-2.952h9.244zM24 2L9.264 22H0L14.736 2H24z"></path></svg></span>GLM-5.3 Flash (max)<span class="tag open">open weights</span><span class="org">Z.ai</span></td><td data-v="0.3199877333333333"><div class="cellbar"><i style="width:44.1px;--bar:var(--c4s-b)"></i><b>0.320</b></div></td><td class="dim" data-v="0.188">0.188</td><td class="dim" data-v="0.848">0.848</td><td class="dim" data-v="0.46533411999999996">0.465</td><td class="dim" data-v="0.24731454">0.247</td><td class="dim" data-v="0.09209057222222222">$0.09</td></tr><tr data-model-key="qwen-on" data-search="qwen 3.8 27b (thinking on) alibaba"><td class="rk">8</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking on)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.2261779866666667"><div class="cellbar"><i style="width:31.1px;--bar:var(--c4s-b)"></i><b>0.226</b></div></td><td class="dim" data-v="0.118">0.118</td><td class="dim" data-v="0.66">0.660</td><td class="dim" data-v="0.29651112">0.297</td><td class="dim" data-v="0.19101142">0.191</td><td class="dim" data-v="0.2605628115151515">$0.26</td></tr><tr data-model-key="deepseek" data-search="deepseek v4.1 flash (high) deepseek"><td class="rk">9</td><td class="nm"><span class="logo"><svg fill="#4D6BFE" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>DeepSeek</title><path d="M23.748 4.482c-.254-.124-.364.113-.512.234-.051.039-.094.09-.137.136-.372.397-.806.657-1.373.626-.829-.046-1.537.214-2.163.848-.133-.782-.575-1.248-1.247-1.548-.352-.156-.708-.311-.955-.65-.172-.241-.219-.51-.305-.774-.055-.16-.11-.323-.293-.35-.2-.031-.278.136-.356.276-.313.572-.434 1.202-.422 1.84.027 1.436.633 2.58 1.838 3.393.137.093.172.187.129.323-.082.28-.18.552-.266.833-.055.179-.137.217-.329.14a5.526 5.526 0 01-1.736-1.18c-.857-.828-1.631-1.742-2.597-2.458a11.365 11.365 0 00-.689-.471c-.985-.957.13-1.743.388-1.836.27-.098.093-.432-.779-.428-.872.004-1.67.295-2.687.684a3.055 3.055 0 01-.465.137 9.597 9.597 0 00-2.883-.102c-1.885.21-3.39 1.102-4.497 2.623C.082 8.606-.231 10.684.152 12.85c.403 2.284 1.569 4.175 3.36 5.653 1.858 1.533 3.997 2.284 6.438 2.14 1.482-.085 3.133-.284 4.994-1.86.47.234.962.327 1.78.397.63.059 1.236-.03 1.705-.128.735-.156.684-.837.419-.961-2.155-1.004-1.682-.595-2.113-.926 1.096-1.296 2.746-2.642 3.392-7.003.05-.347.007-.565 0-.845-.004-.17.035-.237.23-.256a4.173 4.173 0 001.545-.475c1.396-.763 1.96-2.015 2.093-3.517.02-.23-.004-.467-.247-.588zM11.581 18c-2.089-1.642-3.102-2.183-3.52-2.16-.392.024-.321.471-.235.763.09.288.207.486.371.739.114.167.192.416-.113.603-.673.416-1.842-.14-1.897-.167-1.361-.802-2.5-1.86-3.301-3.307-.774-1.393-1.224-2.887-1.298-4.482-.02-.386.093-.522.477-.592a4.696 4.696 0 011.529-.039c2.132.312 3.946 1.265 5.468 2.774.868.86 1.525 1.887 2.202 2.891.72 1.066 1.494 2.082 2.48 2.914.348.292.625.514.891.677-.802.09-2.14.11-3.054-.614zm1-6.44a.306.306 0 01.415-.287.302.302 0 01.2.288.306.306 0 01-.31.307.303.303 0 01-.304-.308zm3.11 1.596c-.2.081-.399.151-.59.16a1.245 1.245 0 01-.798-.254c-.274-.23-.47-.358-.552-.758a1.73 1.73 0 01.016-.588c.07-.327-.008-.537-.239-.727-.187-.156-.426-.199-.688-.199a.559.559 0 01-.254-.078c-.11-.054-.2-.19-.114-.358.028-.054.16-.186.192-.21.356-.202.767-.136 1.146.016.352.144.618.408 1.001.782.391.451.462.576.685.914.176.265.336.537.445.848.067.195-.019.354-.25.452z"></path></svg></span>DeepSeek V4.1 Flash (high)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">DeepSeek</span></td><td data-v="0.21048916"><div class="cellbar"><i style="width:28.9px;--bar:var(--c4s-b)"></i><b>0.210</b></div></td><td class="dim" data-v="0.066">0.066</td><td class="dim" data-v="0.787">0.787</td><td class="dim" data-v="0.18933412">0.189</td><td class="dim" data-v="0.22106668">0.221</td><td class="dim" data-v="0.054194520202020195">$0.05</td></tr><tr data-model-key="qwen-off" data-search="qwen 3.8 27b (thinking off) alibaba"><td class="rk">10</td><td class="nm"><span class="logo"><svg fill="#615CED" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Qwen</title><path d="M12.604 1.34c.393.69.784 1.382 1.174 2.075a.18.18 0 00.157.091h5.552c.174 0 .322.11.446.327l1.454 2.57c.19.337.24.478.024.837-.26.43-.513.864-.76 1.3l-.367.658c-.106.196-.223.28-.04.512l2.652 4.637c.172.301.111.494-.043.77-.437.785-.882 1.564-1.335 2.34-.159.272-.352.375-.68.37-.777-.016-1.552-.01-2.327.016a.099.099 0 00-.081.05 575.097 575.097 0 01-2.705 4.74c-.169.293-.38.363-.725.364-.997.003-2.002.004-3.017.002a.537.537 0 01-.465-.271l-1.335-2.323a.09.09 0 00-.083-.049H4.982c-.285.03-.553-.001-.805-.092l-1.603-2.77a.543.543 0 01-.002-.54l1.207-2.12a.198.198 0 000-.197 550.951 550.951 0 01-1.875-3.272l-.79-1.395c-.16-.31-.173-.496.095-.965.465-.813.927-1.625 1.387-2.436.132-.234.304-.334.584-.335a338.3 338.3 0 012.589-.001.124.124 0 00.107-.063l2.806-4.895a.488.488 0 01.422-.246c.524-.001 1.053 0 1.583-.006L11.704 1c.341-.003.724.032.9.34zm-3.432.403a.06.06 0 00-.052.03L6.254 6.788a.157.157 0 01-.135.078H3.253c-.056 0-.07.025-.041.074l5.81 10.156c.025.042.013.062-.034.063l-2.795.015a.218.218 0 00-.2.116l-1.32 2.31c-.044.078-.021.118.068.118l5.716.008c.046 0 .08.02.104.061l1.403 2.454c.046.081.092.082.139 0l5.006-8.76.783-1.382a.055.055 0 01.096 0l1.424 2.53a.122.122 0 00.107.062l2.763-.02a.04.04 0 00.035-.02.041.041 0 000-.04l-2.9-5.086a.108.108 0 010-.113l.293-.507 1.12-1.977c.024-.041.012-.062-.035-.062H9.2c-.059 0-.073-.026-.043-.077l1.434-2.505a.107.107 0 000-.114L9.225 1.774a.06.06 0 00-.053-.031zm6.29 8.02c.046 0 .058.02.034.06l-.832 1.465-2.613 4.585a.056.056 0 01-.05.029.058.058 0 01-.05-.029L8.498 9.841c-.02-.034-.01-.052.028-.054l.216-.012 6.722-.012z"></path></svg></span>Qwen 3.8 27B (thinking off)<span class="tag open">open weights</span><span class="org">Alibaba</span></td><td data-v="0.19970338666666668"><div class="cellbar"><i style="width:27.5px;--bar:var(--c4s-b)"></i><b>0.200</b></div></td><td class="dim" data-v="0.083">0.083</td><td class="dim" data-v="0.667">0.667</td><td class="dim" data-v="0.26629816">0.266</td><td class="dim" data-v="0.166406">0.166</td><td class="dim" data-v="0.27672816366207137">$0.28</td></tr><tr data-model-key="inkling" data-search="inkling (high) thinking machines"><td class="rk">11</td><td class="nm"><span class="logo"><svg fill="currentColor" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Thinking Machines</title><rect height="15.6" rx="3.6" width="15.6" x="4.2" y="4.2"></rect></svg> | |
| </span>Inkling (high)<span class="org">Thinking Machines</span></td><td data-v="0.19801974666666666"><div class="cellbar"><i style="width:27.3px;--bar:var(--c4s-b)"></i><b>0.198</b></div></td><td class="dim" data-v="0.095">0.095</td><td class="dim" data-v="0.609">0.609</td><td class="dim" data-v="0.1690288">0.169</td><td class="dim" data-v="0.21251522">0.213</td><td class="dim" data-v="0.7541276882539681">$0.75</td></tr><tr data-model-key="grok" data-search="grok 4.6 (high) xai"><td class="rk">12</td><td class="nm"><span class="logo"><svg fill="currentColor" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grok</title><path d="M9.27 15.29l7.978-5.897c.391-.29.95-.177 1.137.272.98 2.369.542 5.215-1.41 7.169-1.951 1.954-4.667 2.382-7.149 1.406l-2.711 1.257c3.889 2.661 8.611 2.003 11.562-.953 2.341-2.344 3.066-5.539 2.388-8.42l.006.007c-.983-4.232.242-5.924 2.75-9.383.06-.082.12-.164.179-.248l-3.301 3.305v-.01L9.267 15.292M7.623 16.723c-2.792-2.67-2.31-6.801.071-9.184 1.761-1.763 4.647-2.483 7.166-1.425l2.705-1.25a7.808 7.808 0 00-1.829-1A8.975 8.975 0 005.984 5.83c-2.533 2.536-3.33 6.436-1.962 9.764 1.022 2.487-.653 4.246-2.34 6.022-.599.63-1.199 1.259-1.682 1.925l7.62-6.815"></path></svg></span>Grok 4.6 (high)<span class="org">xAI</span></td><td data-v="0.18414012"><div class="cellbar"><i style="width:25.3px;--bar:var(--c4s-b)"></i><b>0.184</b></div></td><td class="dim" data-v="0.044">0.044</td><td class="dim" data-v="0.744">0.744</td><td class="dim" data-v="0.1968008">0.197</td><td class="dim" data-v="0.17780978">0.178</td><td class="dim" data-v="0.2634673259259259">$0.26</td></tr><tr data-model-key="gemma-on" data-search="gemma 4 31b (thinking on) google"><td class="rk">13</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-41)" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><lineargradient id="c4sGem-41" x1="0" x2="1" y1="0" y2="1"><stop offset="0" stop-color="#4796E3"></stop><stop offset=".55" stop-color="#9168C0"></stop><stop offset="1" stop-color="#D96570"></stop></lineargradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking on)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.12554015999999998"><div class="cellbar"><i style="width:17.3px;--bar:var(--c4s-b)"></i><b>0.126</b></div></td><td class="dim" data-v="0.003">0.003</td><td class="dim" data-v="0.615">0.615</td><td class="dim" data-v="0.12704028">0.127</td><td class="dim" data-v="0.1247901">0.125</td><td class="dim" data-v="0.028434150793650796">$0.03</td></tr><tr data-model-key="gemma-off" data-search="gemma 4 31b (thinking off) google"><td class="rk">14</td><td class="nm"><span class="logo"><svg fill="url(#c4sGem-42)" fill-rule="evenodd" viewbox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><defs><lineargradient id="c4sGem-42" x1="0" x2="1" y1="0" y2="1"><stop offset="0" stop-color="#4796E3"></stop><stop offset=".55" stop-color="#9168C0"></stop><stop offset="1" stop-color="#D96570"></stop></lineargradient></defs><title>Gemini</title><path d="M20.616 10.835a14.147 14.147 0 01-4.45-3.001 14.111 14.111 0 01-3.678-6.452.503.503 0 00-.975 0 14.134 14.134 0 01-3.679 6.452 14.155 14.155 0 01-4.45 3.001c-.65.28-1.318.505-2.002.678a.502.502 0 000 .975c.684.172 1.35.397 2.002.677a14.147 14.147 0 014.45 3.001 14.112 14.112 0 013.679 6.453.502.502 0 00.975 0c.172-.685.397-1.351.677-2.003a14.145 14.145 0 013.001-4.45 14.113 14.113 0 016.453-3.678.503.503 0 000-.975 13.245 13.245 0 01-2.003-.678z"></path></svg></span>Gemma 4 31B (thinking off)<span class="tag open">open weights</span><span class="tag front">Pareto</span><span class="org">Google</span></td><td data-v="0.11503794666666667"><div class="cellbar"><i style="width:15.8px;--bar:var(--c4s-b)"></i><b>0.115</b></div></td><td class="dim" data-v="0.001">0.001</td><td class="dim" data-v="0.572">0.572</td><td class="dim" data-v="0.11239600000000001">0.112</td><td class="dim" data-v="0.11635892">0.116</td><td class="dim" data-v="0.01913622993197279">$0.02</td></tr></tbody></table></div></div> | |
| <p class="board-note">Click a column to sort. Pareto: on the score-against-cost frontier.</p></div></div> | |
| </div></section><section id="cases"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Cases</span><h2 class="section-title">Visualizing agent outputs</h2> | |
| <p class="section-desc" data-view="t2s">Drag any scene to inspect the saved 3D output, or open a case to explore every agent.</p><p class="section-desc" data-view="i2s" style="display:none">Drag any scene to inspect the saved 3D output. Switch each repair between the saved scene, its corrupted input and the ground truth, or open a case to explore every agent.</p></div> | |
| <div class="lb-tabs"><div class="seg seg-lg" data-for="cases"><button class="on" data-view="t2s">Text-to-Scene</button><button data-view="i2s">Image-to-Scene</button></div></div><div class="case-grid" data-view="t2s"><article class="case-card case-feature"> | |
| <div class="live-scene" data-agent="astra" data-case="industrial-harbor" data-glb="models/300f1aa5a401127f000d.bin?v=1791183752"><canvas aria-label="Interactive 3D scene: Industrial Harbor. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div> | |
| <div class="meta"> | |
| <span class="eyebrow">Text-to-Scene · Showcase</span> | |
| <h4>Industrial Harbor</h4> | |
| <p>GPT-6 Astra (max) · 3,949 actors, built in one agent session from an empty 130 m stage</p> | |
| <blockquote class="feature-prompt">An industrial harbor loading dock with shipping containers, barrels, cranes, warehouse props, pallets, and warning signs.</blockquote> | |
| <a class="text-button" href="https://simworld-ai-industrial-harbor-viewer.static.hf.space/" rel="noopener" target="_blank">Open at full texture resolution ↗</a> | |
| <p class="feature-note">Streams about 1.2 GB of textures on first load.</p> | |
| </div> | |
| </article><article class="case-card"><div class="live-scene" data-agent="astra" data-case="nordic-harbour"><canvas aria-label="Interactive 3D scene: Nordic Harbour. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div class="meta"><span class="eyebrow">Text-to-Scene</span><h4>Nordic Harbour</h4><p>GPT-6 Astra (max) · score 0.877</p><a class="text-button" href="cases.html#nordic-harbour">Compare all 14 agents ↗</a></div></article><article class="case-card"><div class="live-scene" data-agent="fable" data-case="medieval-big-farm-town"><canvas aria-label="Interactive 3D scene: Medieval Big Farm Town. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div class="meta"><span class="eyebrow">Text-to-Scene</span><h4>Medieval Big Farm Town</h4><p>Claude Fable 5.1 (max) · score 0.830</p><a class="text-button" href="cases.html#medieval-big-farm-town">Compare all 14 agents ↗</a></div></article><article class="case-card"><div class="live-scene" data-agent="opus" data-case="egyptian-temple"><canvas aria-label="Interactive 3D scene: Egyptian Temple. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div class="meta"><span class="eyebrow">Text-to-Scene</span><h4>Egyptian Temple</h4><p>Claude Opus 5 (max) · score 0.777</p><a class="text-button" href="cases.html#egyptian-temple">Compare all 14 agents ↗</a></div></article><article class="case-card"><div class="live-scene" data-agent="fable" data-case="bazaar"><canvas aria-label="Interactive 3D scene: Bazaar. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div class="meta"><span class="eyebrow">Text-to-Scene</span><h4>Bazaar</h4><p>Claude Fable 5.1 (max) · score 0.930</p><a class="text-button" href="cases.html#bazaar">Compare all 14 agents ↗</a></div></article></div><div class="case-grid" data-view="i2s" style="display:none"><article class="case-card"><div class="live-scene" data-agent="astra" data-case="comp-31-old-industrial-pallet-bay-repair-v2"><canvas aria-label="Interactive 3D scene: Old Industrial Pallet Bay. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div aria-label="Scene state" class="scene-versions"><button class="on" data-state="repair">Repair</button><button data-state="input">Corrupted input</button><button data-state="gt">Ground truth</button></div><div class="meta"><span class="eyebrow">Image-to-Scene</span><h4>Old Industrial Pallet Bay</h4><p>GPT-6 Astra (max) · score 1.000</p><a class="text-button" href="cases.html#comp-31-old-industrial-pallet-bay-repair-v2">Compare all 14 agents ↗</a></div></article><article class="case-card"><div class="live-scene" data-agent="fable" data-case="comp-61-new-york-mailbox-pair-repair-v2"><canvas aria-label="Interactive 3D scene: New York Mailbox Pair. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div aria-label="Scene state" class="scene-versions"><button class="on" data-state="repair">Repair</button><button data-state="input">Corrupted input</button><button data-state="gt">Ground truth</button></div><div class="meta"><span class="eyebrow">Image-to-Scene</span><h4>New York Mailbox Pair</h4><p>Claude Fable 5.1 (max) · score 1.000</p><a class="text-button" href="cases.html#comp-61-new-york-mailbox-pair-repair-v2">Compare all 14 agents ↗</a></div></article><article class="case-card"><div class="live-scene" data-agent="opus" data-case="comp-72-suburban-umbrella-pair-repair-v2"><canvas aria-label="Interactive 3D scene: Suburban Umbrella Pair. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div aria-label="Scene state" class="scene-versions"><button class="on" data-state="repair">Repair</button><button data-state="input">Corrupted input</button><button data-state="gt">Ground truth</button></div><div class="meta"><span class="eyebrow">Image-to-Scene</span><h4>Suburban Umbrella Pair</h4><p>Claude Opus 5 (max) · score 1.000</p><a class="text-button" href="cases.html#comp-72-suburban-umbrella-pair-repair-v2">Compare all 14 agents ↗</a></div></article><article class="case-card"><div class="live-scene" data-agent="astra" data-case="comp-17-rosies-service-bin-reset-v3"><canvas aria-label="Interactive 3D scene: Rosie's Service Bin. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div aria-label="Scene state" class="scene-versions"><button class="on" data-state="repair">Repair</button><button data-state="input">Corrupted input</button><button data-state="gt">Ground truth</button></div><div class="meta"><span class="eyebrow">Image-to-Scene</span><h4>Rosie's Service Bin</h4><p>GPT-6 Astra (max) · score 1.000</p><a class="text-button" href="cases.html#comp-17-rosies-service-bin-reset-v3">Compare all 14 agents ↗</a></div></article><article class="case-card"><div class="live-scene" data-agent="astra" data-case="comp-18-rosies-roadside-billboard-reset-v3"><canvas aria-label="Interactive 3D scene: Rosie's Roadside Billboard. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div aria-label="Scene state" class="scene-versions"><button class="on" data-state="repair">Repair</button><button data-state="input">Corrupted input</button><button data-state="gt">Ground truth</button></div><div class="meta"><span class="eyebrow">Image-to-Scene</span><h4>Rosie's Roadside Billboard</h4><p>GPT-6 Astra (max) · score 1.000</p><a class="text-button" href="cases.html#comp-18-rosies-roadside-billboard-reset-v3">Compare all 14 agents ↗</a></div></article><article class="case-card"><div class="live-scene" data-agent="fable" data-case="comp-51-suburban-driveway-mailbox-recovery-v2"><canvas aria-label="Interactive 3D scene: Suburban Driveway Mailbox. Drag to orbit, scroll or use plus and minus to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div aria-label="Scene state" class="scene-versions"><button class="on" data-state="repair">Repair</button><button data-state="input">Corrupted input</button><button data-state="gt">Ground truth</button></div><div class="meta"><span class="eyebrow">Image-to-Scene</span><h4>Suburban Driveway Mailbox</h4><p>Claude Fable 5.1 (max) · score 1.000</p><a class="text-button" href="cases.html#comp-51-suburban-driveway-mailbox-recovery-v2">Compare all 14 agents ↗</a></div></article></div> | |
| <div style="text-align:center;margin-top:2rem"><a class="btn btn-primary" href="cases.html"><svg aria-hidden="true" fill="none" stroke="currentColor" stroke-width="1.5" viewbox="0 0 16 16"><path d="M8 1.5l5.5 3v7L8 14.5l-5.5-3v-7z"></path><path d="M2.5 4.5L8 7.5l5.5-3M8 7.5v7"></path></svg> Open the case explorer</a></div> | |
| </div></section><section class="alt" id="takeaways"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Findings</span><h2 class="section-title">Takeaways</h2> | |
| <p class="section-desc">What the evaluation shows across the 14 agents. Every chart below is drawn from the paper's numbers; hover for values.</p></div> | |
| <div class="lb-tabs"><div class="seg seg-lg" data-for="takeaways"><button class="on" data-view="t2s">Text-to-Scene</button><button data-view="i2s">Image-to-Scene</button></div></div><div class="tk" data-view="t2s"><span class="n">Takeaway</span><h3>Spatial Composition remains the weakest requirement family for all 14 agents.</h3><p class="s">Errors persist even when the required objects are present: generating the right objects does not ensure that their relationships satisfy the specification.</p><div class="figs"><figure><div class="fh">Requirement-family score per agent</div><div class="kit-legend"><span><i style="background:#dedede"></i><span>Identity & Environment</span><em>mean 67</em></span><span><i style="background:#c6c6c6"></i><span>Content & Quantity</span><em>mean 54</em></span><span><i style="background:#a9a9a9"></i><span>Attributes & Materials</span><em>mean 48</em></span><span><i style="background:linear-gradient(90deg,#D97757 0% 25%,#10A37F 25% 50%,#7b1fa2 50% 75%,#42a5f5 75% 100%)"></i><span><b>Spatial Composition</b>, in the agent’s colour</span><em>mean 36</em></span></div><div aria-label="Requirement-family scores, all 14 configurations" class="bar-scroll" role="region" tabindex="0"><svg aria-label="Requirement-family scores per agent, in Text-to-Scene rank order" class="kit-bars" id="tk-families" role="group" viewbox="0 0 1200 410"></svg></div><figcaption>One group per agent, in Text-to-Scene rank order: Identity & Environment, Content & Quantity, Attributes & Materials, then Spatial Composition, the lowest bar in every group. Scores ×100 (paper Figure 14b).</figcaption></figure><div class="figs two" style="margin-top:0"><figure><div class="fh">The objects are there; the relation is not</div><div class="live-scene" data-agent="sol" data-case="egyptian-temple"><span aria-hidden="true" class="agent-chip" style="background:#10A37F"><svg fill="#fff" viewbox="0 0 24 24"><path d="M9.205 8.658v-2.26c0-.19.072-.333.238-.428l4.543-2.616c.619-.357 1.356-.523 2.117-.523 2.854 0 4.662 2.212 4.662 4.566 0 .167 0 .357-.024.547l-4.71-2.759a.797.797 0 00-.856 0l-5.97 3.473zm10.609 8.8V12.06c0-.333-.143-.57-.429-.737l-5.97-3.473 1.95-1.118a.433.433 0 01.476 0l4.543 2.617c1.309.76 2.189 2.378 2.189 3.948 0 1.808-1.07 3.473-2.76 4.163zM7.802 12.703l-1.95-1.142c-.167-.095-.239-.238-.239-.428V5.899c0-2.545 1.95-4.472 4.591-4.472 1 0 1.927.333 2.712.928L8.23 5.067c-.285.166-.428.404-.428.737v6.898zM12 15.128l-2.795-1.57v-3.33L12 8.658l2.795 1.57v3.33L12 15.128zm1.796 7.23c-1 0-1.927-.332-2.712-.927l4.686-2.712c.285-.166.428-.404.428-.737v-6.898l1.974 1.142c.167.095.238.238.238.428v5.233c0 2.545-1.974 4.472-4.614 4.472zm-5.637-5.303l-4.544-2.617c-1.308-.761-2.188-2.378-2.188-3.948A4.482 4.482 0 014.21 6.327v5.423c0 .333.143.571.428.738l5.947 3.449-1.95 1.118a.432.432 0 01-.476 0zm-.262 3.9c-2.688 0-4.662-2.021-4.662-4.519 0-.19.024-.38.047-.57l4.686 2.71c.286.167.571.167.856 0l5.97-3.448v2.26c0 .19-.07.333-.237.428l-4.543 2.616c-.619.357-1.356.523-2.117.523zm5.899 2.83a5.947 5.947 0 005.827-4.756C22.287 18.339 24 15.84 24 13.296c0-1.665-.713-3.282-1.998-4.448.119-.5.19-.999.19-1.498 0-3.401-2.759-5.947-5.946-5.947-.642 0-1.26.095-1.88.31A5.962 5.962 0 0010.205 0a5.947 5.947 0 00-5.827 4.757C1.713 5.447 0 7.945 0 10.49c0 1.666.713 3.283 1.998 4.448-.119.5-.19 1-.19 1.499 0 3.401 2.759 5.946 5.946 5.946.642 0 1.26-.095 1.88-.309a5.96 5.96 0 004.162 1.713z"></path></svg>GPT-5.6 Sol (high)</span><canvas aria-label="Interactive 3D scene: Egyptian Temple by GPT-5.6 Sol. Drag to orbit; scroll to zoom." tabindex="0"></canvas><span class="scene-loading" role="status">Loading 3D scene…</span><span class="scene-hint">Drag to orbit · Scroll to zoom</span><button aria-label="Pause scene rotation" class="scene-motion">Ⅱ</button></div><div class="chips"><span class="chip ok">✓ slab roof <small>0.95</small></span><span class="chip ok">✓ stone coping <small>0.82</small></span><span class="chip no">✗ slab roof enclosed by the coping <small>0.78</small></span></div><figcaption><span>GPT-5.6 Sol’s saved Egyptian Temple scene. The judge finds the roof and stone coping, but flags their spatial relationship. <a href="img/judge_egyptian-temple_sol_s3f_000025.jpg?v=1790731787" rel="noopener" target="_blank">View the judge’s evidence ↗</a></span></figcaption></figure><figure><div class="fh">Mismatch when the objects are present</div><svg aria-label="Mismatch rate when the required objects are present" class="kit-ch" role="img" viewbox="0 0 520 196"><line stroke="#cfcfcf" stroke-dasharray="0.1 4.2" stroke-linecap="round" stroke-width="1.4" x1="212.0" x2="212.0" y1="10" y2="166"></line><line stroke="#cfcfcf" stroke-dasharray="0.1 4.2" stroke-linecap="round" stroke-width="1.4" x1="288.0" x2="288.0" y1="10" y2="166"></line><line stroke="#cfcfcf" stroke-dasharray="0.1 4.2" stroke-linecap="round" stroke-width="1.4" x1="364.0" x2="364.0" y1="10" y2="166"></line><line stroke="#cfcfcf" stroke-dasharray="0.1 4.2" stroke-linecap="round" stroke-width="1.4" x1="440.0" x2="440.0" y1="10" y2="166"></line><line stroke="#e6e6e6" stroke-width="1" x1="136" x2="136" y1="10" y2="166"></line><text fill="#9a9a9a" font-family="IBM Plex Mono, monospace" font-size="12" font-weight="500" text-anchor="middle" x="136.0" y="186">0%</text><text fill="#9a9a9a" font-family="IBM Plex Mono, monospace" font-size="12" font-weight="500" text-anchor="middle" x="212.0" y="186">10%</text><text fill="#9a9a9a" font-family="IBM Plex Mono, monospace" font-size="12" font-weight="500" text-anchor="middle" x="288.0" y="186">20%</text><text fill="#9a9a9a" font-family="IBM Plex Mono, monospace" font-size="12" font-weight="500" text-anchor="middle" x="364.0" y="186">30%</text><text fill="#9a9a9a" font-family="IBM Plex Mono, monospace" font-size="12" font-weight="500" text-anchor="middle" x="440.0" y="186">40%</text><g data-tip="Spatial relation: 32.0% of checks fail although the objects are present"><text fill="#262626" font-family="Inter, sans-serif" font-size="13" font-weight="700" text-anchor="end" x="122" y="40.6">Spatial relation</text><path d="M136,19.0 H374.7 Q379.2,19.0 379.2,23.5 V48.5 Q379.2,53.0 374.7,53.0 H136 Z" fill="#2b3531"></path><text fill="#262626" font-family="IBM Plex Mono, monospace" font-size="15.5" font-weight="500" x="388.2" y="41.4">32.0%</text></g><g data-tip="Distribution: 19.1% of checks fail although the objects are present"><text fill="#262626" font-family="Inter, sans-serif" font-size="13" font-weight="400" text-anchor="end" x="122" y="92.6">Distribution</text><path d="M136,71.0 H276.7 Q281.2,71.0 281.2,75.5 V100.5 Q281.2,105.0 276.7,105.0 H136 Z" fill="#c6c6c6"></path><text fill="#262626" font-family="IBM Plex Mono, monospace" font-size="15.5" font-weight="500" x="290.2" y="93.4">19.1%</text></g><g data-tip="Composition: 4.3% of checks fail although the objects are present"><text fill="#262626" font-family="Inter, sans-serif" font-size="13" font-weight="400" text-anchor="end" x="122" y="144.6">Composition</text><path d="M136,123.0 H164.2 Q168.7,123.0 168.7,127.5 V152.5 Q168.7,157.0 164.2,157.0 H136 Z" fill="#c6c6c6"></path><text fill="#262626" font-family="IBM Plex Mono, monospace" font-size="15.5" font-weight="500" x="177.7" y="145.4">4.3%</text></g></svg><figcaption>Share of checks that fail although every object they name is in the scene, across the benchmark (paper Figure 6a).</figcaption></figure></div></div></div><div class="tk" data-view="i2s" style="display:none"><span class="n">Takeaway 1</span><h3>Construction and editing probe different capabilities: scene-level spatial reasoning and precise control of scene state.</h3><p class="s">Despite nearly identical overall scores, Astra is stronger at construction and Gemini at editing.</p><div class="figs"><figure><div class="ch-legend"><span><i style="background:var(--c4s-a)"></i>Text-to-Scene (construction)</span><span><i style="background:var(--c4s-b)"></i>Image-to-Scene (editing)</span></div><svg aria-label="Text-to-Scene and Image-to-Scene score per agent" class="ch" role="img" viewbox="0 0 880 416"><text class="b" text-anchor="end" x="290.0" y="16.0">← Text-to-Scene</text><text class="b" text-anchor="start" x="590.0" y="16.0">Image-to-Scene →</text><g class="row" data-tip="GPT-6 Astra (max): Text-to-Scene 0.724 · Image-to-Scene 0.515 · overall 0.619"><rect fill="var(--c4s-a)" height="17" rx="3" width="217.2" x="72.8" y="35"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="154.5" x="590.0" y="35"></rect><text class="num b" text-anchor="end" x="66.8" y="47.5">0.724</text><text class="num b" text-anchor="start" x="750.5" y="47.5">0.515</text><text class="b" text-anchor="middle" x="440.0" y="47.5">GPT-6 Astra</text></g><g class="row" data-tip="Gemini 3.8 Flash (high): Text-to-Scene 0.657 · Image-to-Scene 0.581 · overall 0.619"><rect fill="var(--c4s-a)" height="17" rx="3" width="197.1" x="92.9" y="62"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="174.3" x="590.0" y="62"></rect><text class="num b" text-anchor="end" x="86.9" y="74.5">0.657</text><text class="num b" text-anchor="start" x="770.3" y="74.5">0.581</text><text class="b" text-anchor="middle" x="440.0" y="74.5">Gemini 3.8 Flash</text></g><g class="row dim" data-tip="Claude Fable 5.1 (max): Text-to-Scene 0.788 · Image-to-Scene 0.424 · overall 0.606"><rect fill="var(--c4s-a)" height="17" rx="3" width="236.4" x="53.6" y="89"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="127.2" x="590.0" y="89"></rect><text class="num" text-anchor="end" x="47.6" y="101.5">0.788</text><text class="num" text-anchor="start" x="723.2" y="101.5">0.424</text><text class="" text-anchor="middle" x="440.0" y="101.5">Claude Fable 5.1</text></g><g class="row dim" data-tip="Claude Opus 5 (max): Text-to-Scene 0.718 · Image-to-Scene 0.468 · overall 0.593"><rect fill="var(--c4s-a)" height="17" rx="3" width="215.4" x="74.6" y="116"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="140.4" x="590.0" y="116"></rect><text class="num" text-anchor="end" x="68.6" y="128.5">0.718</text><text class="num" text-anchor="start" x="736.4" y="128.5">0.468</text><text class="" text-anchor="middle" x="440.0" y="128.5">Claude Opus 5</text></g><g class="row dim" data-tip="GPT-5.6 Sol (high): Text-to-Scene 0.707 · Image-to-Scene 0.393 · overall 0.550"><rect fill="var(--c4s-a)" height="17" rx="3" width="212.1" x="77.9" y="143"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="117.9" x="590.0" y="143"></rect><text class="num" text-anchor="end" x="71.9" y="155.5">0.707</text><text class="num" text-anchor="start" x="713.9" y="155.5">0.393</text><text class="" text-anchor="middle" x="440.0" y="155.5">GPT-5.6 Sol</text></g><g class="row dim" data-tip="Muse Spark 1.3 (medium): Text-to-Scene 0.646 · Image-to-Scene 0.358 · overall 0.502"><rect fill="var(--c4s-a)" height="17" rx="3" width="193.8" x="96.2" y="170"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="107.4" x="590.0" y="170"></rect><text class="num" text-anchor="end" x="90.2" y="182.5">0.646</text><text class="num" text-anchor="start" x="703.4" y="182.5">0.358</text><text class="" text-anchor="middle" x="440.0" y="182.5">Muse Spark 1.3</text></g><g class="row dim" data-tip="GLM-5.3 Flash (max): Text-to-Scene 0.509 · Image-to-Scene 0.320 · overall 0.415"><rect fill="var(--c4s-a)" height="17" rx="3" width="152.7" x="137.3" y="197"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="96.0" x="590.0" y="197"></rect><text class="num" text-anchor="end" x="131.3" y="209.5">0.509</text><text class="num" text-anchor="start" x="692.0" y="209.5">0.320</text><text class="" text-anchor="middle" x="440.0" y="209.5">GLM-5.3 Flash</text></g><g class="row dim" data-tip="Qwen 3.8 27B (thinking off): Text-to-Scene 0.557 · Image-to-Scene 0.200 · overall 0.378"><rect fill="var(--c4s-a)" height="17" rx="3" width="167.1" x="122.9" y="224"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="60.0" x="590.0" y="224"></rect><text class="num" text-anchor="end" x="116.9" y="236.5">0.557</text><text class="num" text-anchor="start" x="656.0" y="236.5">0.200</text><text class="" text-anchor="middle" x="440.0" y="236.5">Qwen 3.8 27B · off</text></g><g class="row dim" data-tip="Grok 4.6 (high): Text-to-Scene 0.567 · Image-to-Scene 0.184 · overall 0.376"><rect fill="var(--c4s-a)" height="17" rx="3" width="170.1" x="119.9" y="251"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="55.2" x="590.0" y="251"></rect><text class="num" text-anchor="end" x="113.9" y="263.5">0.567</text><text class="num" text-anchor="start" x="651.2" y="263.5">0.184</text><text class="" text-anchor="middle" x="440.0" y="263.5">Grok 4.6</text></g><g class="row dim" data-tip="Qwen 3.8 27B (thinking on): Text-to-Scene 0.516 · Image-to-Scene 0.226 · overall 0.371"><rect fill="var(--c4s-a)" height="17" rx="3" width="154.8" x="135.2" y="278"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="67.8" x="590.0" y="278"></rect><text class="num" text-anchor="end" x="129.2" y="290.5">0.516</text><text class="num" text-anchor="start" x="663.8" y="290.5">0.226</text><text class="" text-anchor="middle" x="440.0" y="290.5">Qwen 3.8 27B · on</text></g><g class="row dim" data-tip="Inkling (high): Text-to-Scene 0.425 · Image-to-Scene 0.198 · overall 0.312"><rect fill="var(--c4s-a)" height="17" rx="3" width="127.5" x="162.5" y="305"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="59.4" x="590.0" y="305"></rect><text class="num" text-anchor="end" x="156.5" y="317.5">0.425</text><text class="num" text-anchor="start" x="655.4" y="317.5">0.198</text><text class="" text-anchor="middle" x="440.0" y="317.5">Inkling</text></g><g class="row dim" data-tip="Gemma 4 31B (thinking on): Text-to-Scene 0.471 · Image-to-Scene 0.126 · overall 0.298"><rect fill="var(--c4s-a)" height="17" rx="3" width="141.3" x="148.7" y="332"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="37.8" x="590.0" y="332"></rect><text class="num" text-anchor="end" x="142.7" y="344.5">0.471</text><text class="num" text-anchor="start" x="633.8" y="344.5">0.126</text><text class="" text-anchor="middle" x="440.0" y="344.5">Gemma 4 31B · on</text></g><g class="row dim" data-tip="Gemma 4 31B (thinking off): Text-to-Scene 0.455 · Image-to-Scene 0.115 · overall 0.285"><rect fill="var(--c4s-a)" height="17" rx="3" width="136.5" x="153.5" y="359"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="34.5" x="590.0" y="359"></rect><text class="num" text-anchor="end" x="147.5" y="371.5">0.455</text><text class="num" text-anchor="start" x="630.5" y="371.5">0.115</text><text class="" text-anchor="middle" x="440.0" y="371.5">Gemma 4 31B · off</text></g><g class="row dim" data-tip="DeepSeek V4.1 Flash (high): Text-to-Scene 0.243 · Image-to-Scene 0.210 · overall 0.227"><rect fill="var(--c4s-a)" height="17" rx="3" width="72.9" x="217.1" y="386"></rect><rect fill="var(--c4s-b)" height="17" rx="3" width="63.0" x="590.0" y="386"></rect><text class="num" text-anchor="end" x="211.1" y="398.5">0.243</text><text class="num" text-anchor="start" x="659.0" y="398.5">0.210</text><text class="" text-anchor="middle" x="440.0" y="398.5">DeepSeek V4.1 Flash</text></g></svg><figcaption>Text-to-Scene (left) and Image-to-Scene (right) score per agent, in overall order (paper Table 2). Astra and Gemini both round to 0.619 overall.</figcaption></figure></div></div><div class="tk" data-view="i2s" style="display:none"><span class="n">Takeaway 2</span><h3>Editing ability varies substantially across repair types.</h3><p class="s">Astra performs best on Transform repairs, while Gemini is stronger on Lifecycle and Layout operations.</p><div class="figs"><figure><svg aria-label="Mean Image-to-Scene score by repair type" class="ch" role="img" viewbox="0 0 720 298"><text class="b" text-anchor="middle" x="184.0" y="20.0">GPT-6 Astra</text><text class="b" text-anchor="middle" x="338.0" y="20.0">Gemini 3.8 Flash</text><text class="b" text-anchor="middle" x="492.0" y="20.0">Claude Fable 5.1</text><text class="b" text-anchor="middle" x="646.0" y="20.0">Claude Opus 5</text><text class="b" text-anchor="end" x="98.0" y="62.0">Restore</text><g data-tip="Restore · GPT-6 Astra: 0.324"><rect fill="color-mix(in oklab, var(--c4s-seq) 46%, var(--surface-1))" height="46" rx="6" width="148" x="110" y="34"></rect><text class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px" text-anchor="middle" x="184.0" y="62.0">0.324</text></g><g data-tip="Restore · Gemini 3.8 Flash: 0.376"><rect fill="color-mix(in oklab, var(--c4s-seq) 51%, var(--surface-1))" height="46" rx="6" width="148" x="264" y="34"></rect><text class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px" text-anchor="middle" x="338.0" y="62.0">0.376</text></g><g data-tip="Restore · Claude Fable 5.1: 0.244"><rect fill="color-mix(in oklab, var(--c4s-seq) 37%, var(--surface-1))" height="46" rx="6" width="148" x="418" y="34"></rect><text class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px" text-anchor="middle" x="492.0" y="62.0">0.244</text></g><g data-tip="Restore · Claude Opus 5: 0.388 (best of the four)"><rect fill="color-mix(in oklab, var(--c4s-seq) 53%, var(--surface-1))" height="46" rx="6" width="148" x="572" y="34"></rect><rect fill="none" height="42" rx="5" stroke="var(--c4s-hot)" stroke-width="3.5" width="144" x="574" y="36"></rect><text class="num" style="font-weight:800;fill:var(--text-primary);font-size:15px" text-anchor="middle" x="646.0" y="62.0">0.388</text></g><text class="b" text-anchor="end" x="98.0" y="114.0">Lifecycle</text><g data-tip="Lifecycle · GPT-6 Astra: 0.577"><rect fill="color-mix(in oklab, var(--c4s-seq) 73%, var(--surface-1))" height="46" rx="6" width="148" x="110" y="86"></rect><text class="num" style="font-weight:500;fill:#fff;font-size:15px" text-anchor="middle" x="184.0" y="114.0">0.577</text></g><g data-tip="Lifecycle · Gemini 3.8 Flash: 0.715 (best of the four)"><rect fill="color-mix(in oklab, var(--c4s-seq) 89%, var(--surface-1))" height="46" rx="6" width="148" x="264" y="86"></rect><rect fill="none" height="42" rx="5" stroke="var(--c4s-hot)" stroke-width="3.5" width="144" x="266" y="88"></rect><text class="num" style="font-weight:800;fill:#fff;font-size:15px" text-anchor="middle" x="338.0" y="114.0">0.715</text></g><g data-tip="Lifecycle · Claude Fable 5.1: 0.554"><rect fill="color-mix(in oklab, var(--c4s-seq) 71%, var(--surface-1))" height="46" rx="6" width="148" x="418" y="86"></rect><text class="num" style="font-weight:500;fill:#fff;font-size:15px" text-anchor="middle" x="492.0" y="114.0">0.554</text></g><g data-tip="Lifecycle · Claude Opus 5: 0.593"><rect fill="color-mix(in oklab, var(--c4s-seq) 75%, var(--surface-1))" height="46" rx="6" width="148" x="572" y="86"></rect><text class="num" style="font-weight:500;fill:#fff;font-size:15px" text-anchor="middle" x="646.0" y="114.0">0.593</text></g><text class="b" text-anchor="end" x="98.0" y="166.0">Layout</text><g data-tip="Layout · GPT-6 Astra: 0.596"><rect fill="color-mix(in oklab, var(--c4s-seq) 76%, var(--surface-1))" height="46" rx="6" width="148" x="110" y="138"></rect><text class="num" style="font-weight:500;fill:#fff;font-size:15px" text-anchor="middle" x="184.0" y="166.0">0.596</text></g><g data-tip="Layout · Gemini 3.8 Flash: 0.703 (best of the four)"><rect fill="color-mix(in oklab, var(--c4s-seq) 87%, var(--surface-1))" height="46" rx="6" width="148" x="264" y="138"></rect><rect fill="none" height="42" rx="5" stroke="var(--c4s-hot)" stroke-width="3.5" width="144" x="266" y="140"></rect><text class="num" style="font-weight:800;fill:#fff;font-size:15px" text-anchor="middle" x="338.0" y="166.0">0.703</text></g><g data-tip="Layout · Claude Fable 5.1: 0.464"><rect fill="color-mix(in oklab, var(--c4s-seq) 61%, var(--surface-1))" height="46" rx="6" width="148" x="418" y="138"></rect><text class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px" text-anchor="middle" x="492.0" y="166.0">0.464</text></g><g data-tip="Layout · Claude Opus 5: 0.512"><rect fill="color-mix(in oklab, var(--c4s-seq) 66%, var(--surface-1))" height="46" rx="6" width="148" x="572" y="138"></rect><text class="num" style="font-weight:500;fill:#fff;font-size:15px" text-anchor="middle" x="646.0" y="166.0">0.512</text></g><text class="b" text-anchor="end" x="98.0" y="218.0">Symmetry</text><g data-tip="Symmetry · GPT-6 Astra: 0.466"><rect fill="color-mix(in oklab, var(--c4s-seq) 61%, var(--surface-1))" height="46" rx="6" width="148" x="110" y="190"></rect><text class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px" text-anchor="middle" x="184.0" y="218.0">0.466</text></g><g data-tip="Symmetry · Gemini 3.8 Flash: 0.544"><rect fill="color-mix(in oklab, var(--c4s-seq) 70%, var(--surface-1))" height="46" rx="6" width="148" x="264" y="190"></rect><text class="num" style="font-weight:500;fill:#fff;font-size:15px" text-anchor="middle" x="338.0" y="218.0">0.544</text></g><g data-tip="Symmetry · Claude Fable 5.1: 0.555 (best of the four)"><rect fill="color-mix(in oklab, var(--c4s-seq) 71%, var(--surface-1))" height="46" rx="6" width="148" x="418" y="190"></rect><rect fill="none" height="42" rx="5" stroke="var(--c4s-hot)" stroke-width="3.5" width="144" x="420" y="192"></rect><text class="num" style="font-weight:800;fill:#fff;font-size:15px" text-anchor="middle" x="492.0" y="218.0">0.555</text></g><g data-tip="Symmetry · Claude Opus 5: 0.359"><rect fill="color-mix(in oklab, var(--c4s-seq) 49%, var(--surface-1))" height="46" rx="6" width="148" x="572" y="190"></rect><text class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px" text-anchor="middle" x="646.0" y="218.0">0.359</text></g><text class="b" text-anchor="end" x="98.0" y="270.0">Transform</text><g data-tip="Transform · GPT-6 Astra: 0.613 (best of the four)"><rect fill="color-mix(in oklab, var(--c4s-seq) 77%, var(--surface-1))" height="46" rx="6" width="148" x="110" y="242"></rect><rect fill="none" height="42" rx="5" stroke="var(--c4s-hot)" stroke-width="3.5" width="144" x="112" y="244"></rect><text class="num" style="font-weight:800;fill:#fff;font-size:15px" text-anchor="middle" x="184.0" y="270.0">0.613</text></g><g data-tip="Transform · Gemini 3.8 Flash: 0.532"><rect fill="color-mix(in oklab, var(--c4s-seq) 69%, var(--surface-1))" height="46" rx="6" width="148" x="264" y="242"></rect><text class="num" style="font-weight:500;fill:#fff;font-size:15px" text-anchor="middle" x="338.0" y="270.0">0.532</text></g><g data-tip="Transform · Claude Fable 5.1: 0.353"><rect fill="color-mix(in oklab, var(--c4s-seq) 49%, var(--surface-1))" height="46" rx="6" width="148" x="418" y="242"></rect><text class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px" text-anchor="middle" x="492.0" y="270.0">0.353</text></g><g data-tip="Transform · Claude Opus 5: 0.406"><rect fill="color-mix(in oklab, var(--c4s-seq) 55%, var(--surface-1))" height="46" rx="6" width="148" x="572" y="242"></rect><text class="num" style="font-weight:500;fill:var(--text-primary);font-size:15px" text-anchor="middle" x="646.0" y="270.0">0.406</text></g></svg><figcaption>Mean Image-to-Scene score by repair type for four agents; the outlined cell is the best of the four in its row (paper Figure 6b).</figcaption></figure></div></div><div class="tk" data-view="i2s" style="display:none"><span class="n">Takeaway 3</span><h3>Recovering the target does not guarantee precise editing.</h3><p class="s">Across all 14 configurations, 35.8% of complete recoveries still contain unintended changes to the surrounding scene.</p><div class="figs"><figure><div class="bigstats"><div><b>1,050</b><span>Image-to-Scene evaluations (14 agents × 75 cases)</span></div><div><b style="color:var(--c4s-ok)">212</b><span>recovered every target completely</span></div><div><b style="color:var(--c4s-hot)">76 · 35.8%</b><span>of those still changed the surrounding scene</span></div></div><div class="ch-legend"><span><i style="background:var(--c4s-hot)"></i>unintended edits</span><span><i style="background:var(--c4s-ok)"></i>clean complete recovery</span><span><i style="background:var(--c4s-unit)"></i>no complete recovery</span></div><svg aria-label="1,050 evaluations, 212 complete recoveries, 76 with unintended edits" class="ch" role="img" viewbox="0 0 850 357"><g data-tip="838 evaluations without complete recovery" fill="var(--c4s-unit)"><circle cx="178.5" cy="42.5" r="6.2"></circle><circle cx="178.5" cy="59.5" r="6.2"></circle><circle cx="178.5" cy="76.5" r="6.2"></circle><circle cx="178.5" cy="93.5" r="6.2"></circle><circle cx="178.5" cy="110.5" r="6.2"></circle><circle cx="178.5" cy="127.5" r="6.2"></circle><circle cx="178.5" cy="144.5" r="6.2"></circle><circle cx="178.5" cy="161.5" r="6.2"></circle><circle cx="178.5" cy="178.5" r="6.2"></circle><circle cx="178.5" cy="195.5" r="6.2"></circle><circle cx="178.5" cy="212.5" r="6.2"></circle><circle cx="178.5" cy="229.5" r="6.2"></circle><circle cx="178.5" cy="246.5" r="6.2"></circle><circle cx="178.5" cy="263.5" r="6.2"></circle><circle cx="178.5" cy="280.5" r="6.2"></circle><circle cx="178.5" cy="297.5" r="6.2"></circle><circle cx="178.5" cy="314.5" r="6.2"></circle><circle cx="178.5" cy="331.5" r="6.2"></circle><circle cx="178.5" cy="348.5" r="6.2"></circle><circle cx="195.5" cy="8.5" r="6.2"></circle><circle cx="195.5" cy="25.5" r="6.2"></circle><circle cx="195.5" cy="42.5" r="6.2"></circle><circle cx="195.5" cy="59.5" r="6.2"></circle><circle cx="195.5" cy="76.5" r="6.2"></circle><circle cx="195.5" cy="93.5" r="6.2"></circle><circle cx="195.5" cy="110.5" r="6.2"></circle><circle cx="195.5" cy="127.5" r="6.2"></circle><circle cx="195.5" cy="144.5" r="6.2"></circle><circle cx="195.5" cy="161.5" r="6.2"></circle><circle cx="195.5" cy="178.5" r="6.2"></circle><circle cx="195.5" cy="195.5" r="6.2"></circle><circle cx="195.5" cy="212.5" r="6.2"></circle><circle cx="195.5" cy="229.5" r="6.2"></circle><circle cx="195.5" cy="246.5" r="6.2"></circle><circle cx="195.5" cy="263.5" r="6.2"></circle><circle cx="195.5" cy="280.5" r="6.2"></circle><circle cx="195.5" cy="297.5" r="6.2"></circle><circle cx="195.5" cy="314.5" r="6.2"></circle><circle cx="195.5" cy="331.5" r="6.2"></circle><circle cx="195.5" cy="348.5" r="6.2"></circle><circle cx="212.5" cy="8.5" r="6.2"></circle><circle cx="212.5" cy="25.5" r="6.2"></circle><circle cx="212.5" cy="42.5" r="6.2"></circle><circle cx="212.5" cy="59.5" r="6.2"></circle><circle cx="212.5" cy="76.5" r="6.2"></circle><circle cx="212.5" cy="93.5" r="6.2"></circle><circle cx="212.5" cy="110.5" r="6.2"></circle><circle cx="212.5" cy="127.5" r="6.2"></circle><circle cx="212.5" cy="144.5" r="6.2"></circle><circle cx="212.5" cy="161.5" r="6.2"></circle><circle cx="212.5" cy="178.5" r="6.2"></circle><circle cx="212.5" cy="195.5" r="6.2"></circle><circle cx="212.5" cy="212.5" r="6.2"></circle><circle cx="212.5" cy="229.5" r="6.2"></circle><circle cx="212.5" cy="246.5" r="6.2"></circle><circle cx="212.5" cy="263.5" r="6.2"></circle><circle cx="212.5" cy="280.5" r="6.2"></circle><circle cx="212.5" cy="297.5" r="6.2"></circle><circle cx="212.5" cy="314.5" r="6.2"></circle><circle cx="212.5" cy="331.5" r="6.2"></circle><circle cx="212.5" cy="348.5" r="6.2"></circle><circle cx="229.5" cy="8.5" r="6.2"></circle><circle cx="229.5" cy="25.5" r="6.2"></circle><circle cx="229.5" cy="42.5" r="6.2"></circle><circle cx="229.5" cy="59.5" r="6.2"></circle><circle cx="229.5" cy="76.5" r="6.2"></circle><circle cx="229.5" cy="93.5" r="6.2"></circle><circle cx="229.5" cy="110.5" r="6.2"></circle><circle cx="229.5" cy="127.5" r="6.2"></circle><circle cx="229.5" cy="144.5" r="6.2"></circle><circle cx="229.5" cy="161.5" r="6.2"></circle><circle cx="229.5" cy="178.5" r="6.2"></circle><circle cx="229.5" cy="195.5" r="6.2"></circle><circle cx="229.5" cy="212.5" r="6.2"></circle><circle cx="229.5" cy="229.5" r="6.2"></circle><circle cx="229.5" cy="246.5" r="6.2"></circle><circle cx="229.5" cy="263.5" r="6.2"></circle><circle cx="229.5" cy="280.5" r="6.2"></circle><circle cx="229.5" cy="297.5" r="6.2"></circle><circle cx="229.5" cy="314.5" r="6.2"></circle><circle cx="229.5" cy="331.5" r="6.2"></circle><circle cx="229.5" cy="348.5" r="6.2"></circle><circle cx="246.5" cy="8.5" r="6.2"></circle><circle cx="246.5" cy="25.5" r="6.2"></circle><circle cx="246.5" cy="42.5" r="6.2"></circle><circle cx="246.5" cy="59.5" r="6.2"></circle><circle cx="246.5" cy="76.5" r="6.2"></circle><circle cx="246.5" cy="93.5" r="6.2"></circle><circle cx="246.5" cy="110.5" r="6.2"></circle><circle cx="246.5" cy="127.5" r="6.2"></circle><circle cx="246.5" cy="144.5" r="6.2"></circle><circle cx="246.5" cy="161.5" r="6.2"></circle><circle cx="246.5" cy="178.5" r="6.2"></circle><circle cx="246.5" cy="195.5" r="6.2"></circle><circle cx="246.5" cy="212.5" r="6.2"></circle><circle cx="246.5" cy="229.5" r="6.2"></circle><circle cx="246.5" cy="246.5" r="6.2"></circle><circle cx="246.5" cy="263.5" r="6.2"></circle><circle cx="246.5" cy="280.5" r="6.2"></circle><circle cx="246.5" cy="297.5" r="6.2"></circle><circle cx="246.5" cy="314.5" r="6.2"></circle><circle cx="246.5" cy="331.5" r="6.2"></circle><circle cx="246.5" cy="348.5" r="6.2"></circle><circle cx="263.5" cy="8.5" r="6.2"></circle><circle cx="263.5" cy="25.5" r="6.2"></circle><circle cx="263.5" cy="42.5" r="6.2"></circle><circle cx="263.5" cy="59.5" r="6.2"></circle><circle cx="263.5" cy="76.5" r="6.2"></circle><circle cx="263.5" cy="93.5" r="6.2"></circle><circle cx="263.5" cy="110.5" r="6.2"></circle><circle cx="263.5" cy="127.5" r="6.2"></circle><circle cx="263.5" cy="144.5" r="6.2"></circle><circle cx="263.5" cy="161.5" r="6.2"></circle><circle cx="263.5" cy="178.5" r="6.2"></circle><circle cx="263.5" cy="195.5" r="6.2"></circle><circle cx="263.5" cy="212.5" r="6.2"></circle><circle cx="263.5" cy="229.5" r="6.2"></circle><circle cx="263.5" cy="246.5" r="6.2"></circle><circle cx="263.5" cy="263.5" r="6.2"></circle><circle cx="263.5" cy="280.5" r="6.2"></circle><circle cx="263.5" cy="297.5" r="6.2"></circle><circle cx="263.5" cy="314.5" r="6.2"></circle><circle cx="263.5" cy="331.5" r="6.2"></circle><circle cx="263.5" cy="348.5" r="6.2"></circle><circle cx="280.5" cy="8.5" r="6.2"></circle><circle cx="280.5" cy="25.5" r="6.2"></circle><circle cx="280.5" cy="42.5" r="6.2"></circle><circle cx="280.5" cy="59.5" r="6.2"></circle><circle cx="280.5" cy="76.5" r="6.2"></circle><circle cx="280.5" cy="93.5" r="6.2"></circle><circle cx="280.5" cy="110.5" r="6.2"></circle><circle cx="280.5" cy="127.5" r="6.2"></circle><circle cx="280.5" cy="144.5" r="6.2"></circle><circle cx="280.5" cy="161.5" r="6.2"></circle><circle cx="280.5" cy="178.5" r="6.2"></circle><circle cx="280.5" cy="195.5" r="6.2"></circle><circle cx="280.5" cy="212.5" r="6.2"></circle><circle cx="280.5" cy="229.5" r="6.2"></circle><circle cx="280.5" cy="246.5" r="6.2"></circle><circle cx="280.5" cy="263.5" r="6.2"></circle><circle cx="280.5" cy="280.5" r="6.2"></circle><circle cx="280.5" cy="297.5" r="6.2"></circle><circle cx="280.5" cy="314.5" r="6.2"></circle><circle cx="280.5" cy="331.5" r="6.2"></circle><circle cx="280.5" cy="348.5" r="6.2"></circle><circle cx="297.5" cy="8.5" r="6.2"></circle><circle cx="297.5" cy="25.5" r="6.2"></circle><circle cx="297.5" cy="42.5" r="6.2"></circle><circle cx="297.5" cy="59.5" r="6.2"></circle><circle cx="297.5" cy="76.5" r="6.2"></circle><circle cx="297.5" cy="93.5" r="6.2"></circle><circle cx="297.5" cy="110.5" r="6.2"></circle><circle cx="297.5" cy="127.5" r="6.2"></circle><circle cx="297.5" cy="144.5" r="6.2"></circle><circle cx="297.5" cy="161.5" r="6.2"></circle><circle cx="297.5" cy="178.5" r="6.2"></circle><circle cx="297.5" cy="195.5" r="6.2"></circle><circle cx="297.5" cy="212.5" r="6.2"></circle><circle cx="297.5" cy="229.5" r="6.2"></circle><circle cx="297.5" cy="246.5" r="6.2"></circle><circle cx="297.5" cy="263.5" r="6.2"></circle><circle cx="297.5" cy="280.5" r="6.2"></circle><circle cx="297.5" cy="297.5" r="6.2"></circle><circle cx="297.5" cy="314.5" r="6.2"></circle><circle cx="297.5" cy="331.5" r="6.2"></circle><circle cx="297.5" cy="348.5" r="6.2"></circle><circle cx="314.5" cy="8.5" r="6.2"></circle><circle cx="314.5" cy="25.5" r="6.2"></circle><circle cx="314.5" cy="42.5" r="6.2"></circle><circle cx="314.5" cy="59.5" r="6.2"></circle><circle cx="314.5" cy="76.5" r="6.2"></circle><circle cx="314.5" cy="93.5" r="6.2"></circle><circle cx="314.5" cy="110.5" r="6.2"></circle><circle cx="314.5" cy="127.5" r="6.2"></circle><circle cx="314.5" cy="144.5" r="6.2"></circle><circle cx="314.5" cy="161.5" r="6.2"></circle><circle cx="314.5" cy="178.5" r="6.2"></circle><circle cx="314.5" cy="195.5" r="6.2"></circle><circle cx="314.5" cy="212.5" r="6.2"></circle><circle cx="314.5" cy="229.5" r="6.2"></circle><circle cx="314.5" cy="246.5" r="6.2"></circle><circle cx="314.5" cy="263.5" r="6.2"></circle><circle cx="314.5" cy="280.5" r="6.2"></circle><circle cx="314.5" cy="297.5" r="6.2"></circle><circle cx="314.5" cy="314.5" r="6.2"></circle><circle cx="314.5" cy="331.5" r="6.2"></circle><circle cx="314.5" cy="348.5" r="6.2"></circle><circle cx="331.5" cy="8.5" r="6.2"></circle><circle cx="331.5" cy="25.5" r="6.2"></circle><circle cx="331.5" cy="42.5" r="6.2"></circle><circle cx="331.5" cy="59.5" r="6.2"></circle><circle cx="331.5" cy="76.5" r="6.2"></circle><circle cx="331.5" cy="93.5" r="6.2"></circle><circle cx="331.5" cy="110.5" r="6.2"></circle><circle cx="331.5" cy="127.5" r="6.2"></circle><circle cx="331.5" cy="144.5" r="6.2"></circle><circle cx="331.5" cy="161.5" r="6.2"></circle><circle cx="331.5" cy="178.5" r="6.2"></circle><circle cx="331.5" cy="195.5" r="6.2"></circle><circle cx="331.5" cy="212.5" r="6.2"></circle><circle cx="331.5" cy="229.5" r="6.2"></circle><circle cx="331.5" cy="246.5" r="6.2"></circle><circle cx="331.5" cy="263.5" r="6.2"></circle><circle cx="331.5" cy="280.5" r="6.2"></circle><circle cx="331.5" cy="297.5" r="6.2"></circle><circle cx="331.5" cy="314.5" r="6.2"></circle><circle cx="331.5" cy="331.5" r="6.2"></circle><circle cx="331.5" cy="348.5" r="6.2"></circle><circle cx="348.5" cy="8.5" r="6.2"></circle><circle cx="348.5" cy="25.5" r="6.2"></circle><circle cx="348.5" cy="42.5" r="6.2"></circle><circle cx="348.5" cy="59.5" r="6.2"></circle><circle cx="348.5" cy="76.5" r="6.2"></circle><circle cx="348.5" cy="93.5" r="6.2"></circle><circle cx="348.5" cy="110.5" r="6.2"></circle><circle cx="348.5" cy="127.5" r="6.2"></circle><circle cx="348.5" cy="144.5" r="6.2"></circle><circle cx="348.5" cy="161.5" r="6.2"></circle><circle cx="348.5" cy="178.5" r="6.2"></circle><circle cx="348.5" cy="195.5" r="6.2"></circle><circle cx="348.5" cy="212.5" r="6.2"></circle><circle cx="348.5" cy="229.5" r="6.2"></circle><circle cx="348.5" cy="246.5" r="6.2"></circle><circle cx="348.5" cy="263.5" r="6.2"></circle><circle cx="348.5" cy="280.5" r="6.2"></circle><circle cx="348.5" cy="297.5" r="6.2"></circle><circle cx="348.5" cy="314.5" r="6.2"></circle><circle cx="348.5" cy="331.5" r="6.2"></circle><circle cx="348.5" cy="348.5" r="6.2"></circle><circle cx="365.5" cy="8.5" r="6.2"></circle><circle cx="365.5" cy="25.5" r="6.2"></circle><circle cx="365.5" cy="42.5" r="6.2"></circle><circle cx="365.5" cy="59.5" r="6.2"></circle><circle cx="365.5" cy="76.5" r="6.2"></circle><circle cx="365.5" cy="93.5" r="6.2"></circle><circle cx="365.5" cy="110.5" r="6.2"></circle><circle cx="365.5" cy="127.5" r="6.2"></circle><circle cx="365.5" cy="144.5" r="6.2"></circle><circle cx="365.5" cy="161.5" r="6.2"></circle><circle cx="365.5" cy="178.5" r="6.2"></circle><circle cx="365.5" cy="195.5" r="6.2"></circle><circle cx="365.5" cy="212.5" r="6.2"></circle><circle cx="365.5" cy="229.5" r="6.2"></circle><circle cx="365.5" cy="246.5" r="6.2"></circle><circle cx="365.5" cy="263.5" r="6.2"></circle><circle cx="365.5" cy="280.5" r="6.2"></circle><circle cx="365.5" cy="297.5" r="6.2"></circle><circle cx="365.5" cy="314.5" r="6.2"></circle><circle cx="365.5" cy="331.5" r="6.2"></circle><circle cx="365.5" cy="348.5" r="6.2"></circle><circle cx="382.5" cy="8.5" r="6.2"></circle><circle cx="382.5" cy="25.5" r="6.2"></circle><circle cx="382.5" cy="42.5" r="6.2"></circle><circle cx="382.5" cy="59.5" r="6.2"></circle><circle cx="382.5" cy="76.5" r="6.2"></circle><circle cx="382.5" cy="93.5" r="6.2"></circle><circle cx="382.5" cy="110.5" r="6.2"></circle><circle cx="382.5" cy="127.5" r="6.2"></circle><circle cx="382.5" cy="144.5" r="6.2"></circle><circle cx="382.5" cy="161.5" r="6.2"></circle><circle cx="382.5" cy="178.5" r="6.2"></circle><circle cx="382.5" cy="195.5" r="6.2"></circle><circle cx="382.5" cy="212.5" r="6.2"></circle><circle cx="382.5" cy="229.5" r="6.2"></circle><circle cx="382.5" cy="246.5" r="6.2"></circle><circle cx="382.5" cy="263.5" r="6.2"></circle><circle cx="382.5" cy="280.5" r="6.2"></circle><circle cx="382.5" cy="297.5" r="6.2"></circle><circle cx="382.5" cy="314.5" r="6.2"></circle><circle cx="382.5" cy="331.5" r="6.2"></circle><circle cx="382.5" cy="348.5" r="6.2"></circle><circle cx="399.5" cy="8.5" r="6.2"></circle><circle cx="399.5" cy="25.5" r="6.2"></circle><circle cx="399.5" cy="42.5" r="6.2"></circle><circle cx="399.5" cy="59.5" r="6.2"></circle><circle cx="399.5" cy="76.5" r="6.2"></circle><circle cx="399.5" cy="93.5" r="6.2"></circle><circle cx="399.5" cy="110.5" r="6.2"></circle><circle cx="399.5" cy="127.5" r="6.2"></circle><circle cx="399.5" cy="144.5" r="6.2"></circle><circle cx="399.5" cy="161.5" r="6.2"></circle><circle cx="399.5" cy="178.5" r="6.2"></circle><circle cx="399.5" cy="195.5" r="6.2"></circle><circle cx="399.5" cy="212.5" r="6.2"></circle><circle cx="399.5" cy="229.5" r="6.2"></circle><circle cx="399.5" cy="246.5" r="6.2"></circle><circle cx="399.5" cy="263.5" r="6.2"></circle><circle cx="399.5" cy="280.5" r="6.2"></circle><circle cx="399.5" cy="297.5" r="6.2"></circle><circle cx="399.5" cy="314.5" r="6.2"></circle><circle cx="399.5" cy="331.5" r="6.2"></circle><circle cx="399.5" cy="348.5" r="6.2"></circle><circle cx="416.5" cy="8.5" r="6.2"></circle><circle cx="416.5" cy="25.5" r="6.2"></circle><circle cx="416.5" cy="42.5" r="6.2"></circle><circle cx="416.5" cy="59.5" r="6.2"></circle><circle cx="416.5" cy="76.5" r="6.2"></circle><circle cx="416.5" cy="93.5" r="6.2"></circle><circle cx="416.5" cy="110.5" r="6.2"></circle><circle cx="416.5" cy="127.5" r="6.2"></circle><circle cx="416.5" cy="144.5" r="6.2"></circle><circle cx="416.5" cy="161.5" r="6.2"></circle><circle cx="416.5" cy="178.5" r="6.2"></circle><circle cx="416.5" cy="195.5" r="6.2"></circle><circle cx="416.5" cy="212.5" r="6.2"></circle><circle cx="416.5" cy="229.5" r="6.2"></circle><circle cx="416.5" cy="246.5" r="6.2"></circle><circle cx="416.5" cy="263.5" r="6.2"></circle><circle cx="416.5" cy="280.5" r="6.2"></circle><circle cx="416.5" cy="297.5" r="6.2"></circle><circle cx="416.5" cy="314.5" r="6.2"></circle><circle cx="416.5" cy="331.5" r="6.2"></circle><circle cx="416.5" cy="348.5" r="6.2"></circle><circle cx="433.5" cy="8.5" r="6.2"></circle><circle cx="433.5" cy="25.5" r="6.2"></circle><circle cx="433.5" cy="42.5" r="6.2"></circle><circle cx="433.5" cy="59.5" r="6.2"></circle><circle cx="433.5" cy="76.5" r="6.2"></circle><circle cx="433.5" cy="93.5" r="6.2"></circle><circle cx="433.5" cy="110.5" r="6.2"></circle><circle cx="433.5" cy="127.5" r="6.2"></circle><circle cx="433.5" cy="144.5" r="6.2"></circle><circle cx="433.5" cy="161.5" r="6.2"></circle><circle cx="433.5" cy="178.5" r="6.2"></circle><circle cx="433.5" cy="195.5" r="6.2"></circle><circle cx="433.5" cy="212.5" r="6.2"></circle><circle cx="433.5" cy="229.5" r="6.2"></circle><circle cx="433.5" cy="246.5" r="6.2"></circle><circle cx="433.5" cy="263.5" r="6.2"></circle><circle cx="433.5" cy="280.5" r="6.2"></circle><circle cx="433.5" cy="297.5" r="6.2"></circle><circle cx="433.5" cy="314.5" r="6.2"></circle><circle cx="433.5" cy="331.5" r="6.2"></circle><circle cx="433.5" cy="348.5" r="6.2"></circle><circle cx="450.5" cy="8.5" r="6.2"></circle><circle cx="450.5" cy="25.5" r="6.2"></circle><circle cx="450.5" cy="42.5" r="6.2"></circle><circle cx="450.5" cy="59.5" r="6.2"></circle><circle cx="450.5" cy="76.5" r="6.2"></circle><circle cx="450.5" cy="93.5" r="6.2"></circle><circle cx="450.5" cy="110.5" r="6.2"></circle><circle cx="450.5" cy="127.5" r="6.2"></circle><circle cx="450.5" cy="144.5" r="6.2"></circle><circle cx="450.5" cy="161.5" r="6.2"></circle><circle cx="450.5" cy="178.5" r="6.2"></circle><circle cx="450.5" cy="195.5" r="6.2"></circle><circle cx="450.5" cy="212.5" r="6.2"></circle><circle cx="450.5" cy="229.5" r="6.2"></circle><circle cx="450.5" cy="246.5" r="6.2"></circle><circle cx="450.5" cy="263.5" r="6.2"></circle><circle cx="450.5" cy="280.5" r="6.2"></circle><circle cx="450.5" cy="297.5" r="6.2"></circle><circle cx="450.5" cy="314.5" r="6.2"></circle><circle cx="450.5" cy="331.5" r="6.2"></circle><circle cx="450.5" cy="348.5" r="6.2"></circle><circle cx="467.5" cy="8.5" r="6.2"></circle><circle cx="467.5" cy="25.5" r="6.2"></circle><circle cx="467.5" cy="42.5" r="6.2"></circle><circle cx="467.5" cy="59.5" r="6.2"></circle><circle cx="467.5" cy="76.5" r="6.2"></circle><circle cx="467.5" cy="93.5" r="6.2"></circle><circle cx="467.5" cy="110.5" r="6.2"></circle><circle cx="467.5" cy="127.5" r="6.2"></circle><circle cx="467.5" cy="144.5" r="6.2"></circle><circle cx="467.5" cy="161.5" r="6.2"></circle><circle cx="467.5" cy="178.5" r="6.2"></circle><circle cx="467.5" cy="195.5" r="6.2"></circle><circle cx="467.5" cy="212.5" r="6.2"></circle><circle cx="467.5" cy="229.5" r="6.2"></circle><circle cx="467.5" cy="246.5" r="6.2"></circle><circle cx="467.5" cy="263.5" r="6.2"></circle><circle cx="467.5" cy="280.5" r="6.2"></circle><circle cx="467.5" cy="297.5" r="6.2"></circle><circle cx="467.5" cy="314.5" r="6.2"></circle><circle cx="467.5" cy="331.5" r="6.2"></circle><circle cx="467.5" cy="348.5" r="6.2"></circle><circle cx="484.5" cy="8.5" r="6.2"></circle><circle cx="484.5" cy="25.5" r="6.2"></circle><circle cx="484.5" cy="42.5" r="6.2"></circle><circle cx="484.5" cy="59.5" r="6.2"></circle><circle cx="484.5" cy="76.5" r="6.2"></circle><circle cx="484.5" cy="93.5" r="6.2"></circle><circle cx="484.5" cy="110.5" r="6.2"></circle><circle cx="484.5" cy="127.5" r="6.2"></circle><circle cx="484.5" cy="144.5" r="6.2"></circle><circle cx="484.5" cy="161.5" r="6.2"></circle><circle cx="484.5" cy="178.5" r="6.2"></circle><circle cx="484.5" cy="195.5" r="6.2"></circle><circle cx="484.5" cy="212.5" r="6.2"></circle><circle cx="484.5" cy="229.5" r="6.2"></circle><circle cx="484.5" cy="246.5" r="6.2"></circle><circle cx="484.5" cy="263.5" r="6.2"></circle><circle cx="484.5" cy="280.5" r="6.2"></circle><circle cx="484.5" cy="297.5" r="6.2"></circle><circle cx="484.5" cy="314.5" r="6.2"></circle><circle cx="484.5" cy="331.5" r="6.2"></circle><circle cx="484.5" cy="348.5" r="6.2"></circle><circle cx="501.5" cy="8.5" r="6.2"></circle><circle cx="501.5" cy="25.5" r="6.2"></circle><circle cx="501.5" cy="42.5" r="6.2"></circle><circle cx="501.5" cy="59.5" r="6.2"></circle><circle cx="501.5" cy="76.5" r="6.2"></circle><circle cx="501.5" cy="93.5" r="6.2"></circle><circle cx="501.5" cy="110.5" r="6.2"></circle><circle cx="501.5" cy="127.5" r="6.2"></circle><circle cx="501.5" cy="144.5" r="6.2"></circle><circle cx="501.5" cy="161.5" r="6.2"></circle><circle cx="501.5" cy="178.5" r="6.2"></circle><circle cx="501.5" cy="195.5" r="6.2"></circle><circle cx="501.5" cy="212.5" r="6.2"></circle><circle cx="501.5" cy="229.5" r="6.2"></circle><circle cx="501.5" cy="246.5" r="6.2"></circle><circle cx="501.5" cy="263.5" r="6.2"></circle><circle cx="501.5" cy="280.5" r="6.2"></circle><circle cx="501.5" cy="297.5" r="6.2"></circle><circle cx="501.5" cy="314.5" r="6.2"></circle><circle cx="501.5" cy="331.5" r="6.2"></circle><circle cx="501.5" cy="348.5" r="6.2"></circle><circle cx="518.5" cy="8.5" r="6.2"></circle><circle cx="518.5" cy="25.5" r="6.2"></circle><circle cx="518.5" cy="42.5" r="6.2"></circle><circle cx="518.5" cy="59.5" r="6.2"></circle><circle cx="518.5" cy="76.5" r="6.2"></circle><circle cx="518.5" cy="93.5" r="6.2"></circle><circle cx="518.5" cy="110.5" r="6.2"></circle><circle cx="518.5" cy="127.5" r="6.2"></circle><circle cx="518.5" cy="144.5" r="6.2"></circle><circle cx="518.5" cy="161.5" r="6.2"></circle><circle cx="518.5" cy="178.5" r="6.2"></circle><circle cx="518.5" cy="195.5" r="6.2"></circle><circle cx="518.5" cy="212.5" r="6.2"></circle><circle cx="518.5" cy="229.5" r="6.2"></circle><circle cx="518.5" cy="246.5" r="6.2"></circle><circle cx="518.5" cy="263.5" r="6.2"></circle><circle cx="518.5" cy="280.5" r="6.2"></circle><circle cx="518.5" cy="297.5" r="6.2"></circle><circle cx="518.5" cy="314.5" r="6.2"></circle><circle cx="518.5" cy="331.5" r="6.2"></circle><circle cx="518.5" cy="348.5" r="6.2"></circle><circle cx="535.5" cy="8.5" r="6.2"></circle><circle cx="535.5" cy="25.5" r="6.2"></circle><circle cx="535.5" cy="42.5" r="6.2"></circle><circle cx="535.5" cy="59.5" r="6.2"></circle><circle cx="535.5" cy="76.5" r="6.2"></circle><circle cx="535.5" cy="93.5" r="6.2"></circle><circle cx="535.5" cy="110.5" r="6.2"></circle><circle cx="535.5" cy="127.5" r="6.2"></circle><circle cx="535.5" cy="144.5" r="6.2"></circle><circle cx="535.5" cy="161.5" r="6.2"></circle><circle cx="535.5" cy="178.5" r="6.2"></circle><circle cx="535.5" cy="195.5" r="6.2"></circle><circle cx="535.5" cy="212.5" r="6.2"></circle><circle cx="535.5" cy="229.5" r="6.2"></circle><circle cx="535.5" cy="246.5" r="6.2"></circle><circle cx="535.5" cy="263.5" r="6.2"></circle><circle cx="535.5" cy="280.5" r="6.2"></circle><circle cx="535.5" cy="297.5" r="6.2"></circle><circle cx="535.5" cy="314.5" r="6.2"></circle><circle cx="535.5" cy="331.5" r="6.2"></circle><circle cx="535.5" cy="348.5" r="6.2"></circle><circle cx="552.5" cy="8.5" r="6.2"></circle><circle cx="552.5" cy="25.5" r="6.2"></circle><circle cx="552.5" cy="42.5" r="6.2"></circle><circle cx="552.5" cy="59.5" r="6.2"></circle><circle cx="552.5" cy="76.5" r="6.2"></circle><circle cx="552.5" cy="93.5" r="6.2"></circle><circle cx="552.5" cy="110.5" r="6.2"></circle><circle cx="552.5" cy="127.5" r="6.2"></circle><circle cx="552.5" cy="144.5" r="6.2"></circle><circle cx="552.5" cy="161.5" r="6.2"></circle><circle cx="552.5" cy="178.5" r="6.2"></circle><circle cx="552.5" cy="195.5" r="6.2"></circle><circle cx="552.5" cy="212.5" r="6.2"></circle><circle cx="552.5" cy="229.5" r="6.2"></circle><circle cx="552.5" cy="246.5" r="6.2"></circle><circle cx="552.5" cy="263.5" r="6.2"></circle><circle cx="552.5" cy="280.5" r="6.2"></circle><circle cx="552.5" cy="297.5" r="6.2"></circle><circle cx="552.5" cy="314.5" r="6.2"></circle><circle cx="552.5" cy="331.5" r="6.2"></circle><circle cx="552.5" cy="348.5" r="6.2"></circle><circle cx="569.5" cy="8.5" r="6.2"></circle><circle cx="569.5" cy="25.5" r="6.2"></circle><circle cx="569.5" cy="42.5" r="6.2"></circle><circle cx="569.5" cy="59.5" r="6.2"></circle><circle cx="569.5" cy="76.5" r="6.2"></circle><circle cx="569.5" cy="93.5" r="6.2"></circle><circle cx="569.5" cy="110.5" r="6.2"></circle><circle cx="569.5" cy="127.5" r="6.2"></circle><circle cx="569.5" cy="144.5" r="6.2"></circle><circle cx="569.5" cy="161.5" r="6.2"></circle><circle cx="569.5" cy="178.5" r="6.2"></circle><circle cx="569.5" cy="195.5" r="6.2"></circle><circle cx="569.5" cy="212.5" r="6.2"></circle><circle cx="569.5" cy="229.5" r="6.2"></circle><circle cx="569.5" cy="246.5" r="6.2"></circle><circle cx="569.5" cy="263.5" r="6.2"></circle><circle cx="569.5" cy="280.5" r="6.2"></circle><circle cx="569.5" cy="297.5" r="6.2"></circle><circle cx="569.5" cy="314.5" r="6.2"></circle><circle cx="569.5" cy="331.5" r="6.2"></circle><circle cx="569.5" cy="348.5" r="6.2"></circle><circle cx="586.5" cy="8.5" r="6.2"></circle><circle cx="586.5" cy="25.5" r="6.2"></circle><circle cx="586.5" cy="42.5" r="6.2"></circle><circle cx="586.5" cy="59.5" r="6.2"></circle><circle cx="586.5" cy="76.5" r="6.2"></circle><circle cx="586.5" cy="93.5" r="6.2"></circle><circle cx="586.5" cy="110.5" r="6.2"></circle><circle cx="586.5" cy="127.5" r="6.2"></circle><circle cx="586.5" cy="144.5" r="6.2"></circle><circle cx="586.5" cy="161.5" r="6.2"></circle><circle cx="586.5" cy="178.5" r="6.2"></circle><circle cx="586.5" cy="195.5" r="6.2"></circle><circle cx="586.5" cy="212.5" r="6.2"></circle><circle cx="586.5" cy="229.5" r="6.2"></circle><circle cx="586.5" cy="246.5" r="6.2"></circle><circle cx="586.5" cy="263.5" r="6.2"></circle><circle cx="586.5" cy="280.5" r="6.2"></circle><circle cx="586.5" cy="297.5" r="6.2"></circle><circle cx="586.5" cy="314.5" r="6.2"></circle><circle cx="586.5" cy="331.5" r="6.2"></circle><circle cx="586.5" cy="348.5" r="6.2"></circle><circle cx="603.5" cy="8.5" r="6.2"></circle><circle cx="603.5" cy="25.5" r="6.2"></circle><circle cx="603.5" cy="42.5" r="6.2"></circle><circle cx="603.5" cy="59.5" r="6.2"></circle><circle cx="603.5" cy="76.5" r="6.2"></circle><circle cx="603.5" cy="93.5" r="6.2"></circle><circle cx="603.5" cy="110.5" r="6.2"></circle><circle cx="603.5" cy="127.5" r="6.2"></circle><circle cx="603.5" cy="144.5" r="6.2"></circle><circle cx="603.5" cy="161.5" r="6.2"></circle><circle cx="603.5" cy="178.5" r="6.2"></circle><circle cx="603.5" cy="195.5" r="6.2"></circle><circle cx="603.5" cy="212.5" r="6.2"></circle><circle cx="603.5" cy="229.5" r="6.2"></circle><circle cx="603.5" cy="246.5" r="6.2"></circle><circle cx="603.5" cy="263.5" r="6.2"></circle><circle cx="603.5" cy="280.5" r="6.2"></circle><circle cx="603.5" cy="297.5" r="6.2"></circle><circle cx="603.5" cy="314.5" r="6.2"></circle><circle cx="603.5" cy="331.5" r="6.2"></circle><circle cx="603.5" cy="348.5" r="6.2"></circle><circle cx="620.5" cy="8.5" r="6.2"></circle><circle cx="620.5" cy="25.5" r="6.2"></circle><circle cx="620.5" cy="42.5" r="6.2"></circle><circle cx="620.5" cy="59.5" r="6.2"></circle><circle cx="620.5" cy="76.5" r="6.2"></circle><circle cx="620.5" cy="93.5" r="6.2"></circle><circle cx="620.5" cy="110.5" r="6.2"></circle><circle cx="620.5" cy="127.5" r="6.2"></circle><circle cx="620.5" cy="144.5" r="6.2"></circle><circle cx="620.5" cy="161.5" r="6.2"></circle><circle cx="620.5" cy="178.5" r="6.2"></circle><circle cx="620.5" cy="195.5" r="6.2"></circle><circle cx="620.5" cy="212.5" r="6.2"></circle><circle cx="620.5" cy="229.5" r="6.2"></circle><circle cx="620.5" cy="246.5" r="6.2"></circle><circle cx="620.5" cy="263.5" r="6.2"></circle><circle cx="620.5" cy="280.5" r="6.2"></circle><circle cx="620.5" cy="297.5" r="6.2"></circle><circle cx="620.5" cy="314.5" r="6.2"></circle><circle cx="620.5" cy="331.5" r="6.2"></circle><circle cx="620.5" cy="348.5" r="6.2"></circle><circle cx="637.5" cy="8.5" r="6.2"></circle><circle cx="637.5" cy="25.5" r="6.2"></circle><circle cx="637.5" cy="42.5" r="6.2"></circle><circle cx="637.5" cy="59.5" r="6.2"></circle><circle cx="637.5" cy="76.5" r="6.2"></circle><circle cx="637.5" cy="93.5" r="6.2"></circle><circle cx="637.5" cy="110.5" r="6.2"></circle><circle cx="637.5" cy="127.5" r="6.2"></circle><circle cx="637.5" cy="144.5" r="6.2"></circle><circle cx="637.5" cy="161.5" r="6.2"></circle><circle cx="637.5" cy="178.5" r="6.2"></circle><circle cx="637.5" cy="195.5" r="6.2"></circle><circle cx="637.5" cy="212.5" r="6.2"></circle><circle cx="637.5" cy="229.5" r="6.2"></circle><circle cx="637.5" cy="246.5" r="6.2"></circle><circle cx="637.5" cy="263.5" r="6.2"></circle><circle cx="637.5" cy="280.5" r="6.2"></circle><circle cx="637.5" cy="297.5" r="6.2"></circle><circle cx="637.5" cy="314.5" r="6.2"></circle><circle cx="637.5" cy="331.5" r="6.2"></circle><circle cx="637.5" cy="348.5" r="6.2"></circle><circle cx="654.5" cy="8.5" r="6.2"></circle><circle cx="654.5" cy="25.5" r="6.2"></circle><circle cx="654.5" cy="42.5" r="6.2"></circle><circle cx="654.5" cy="59.5" r="6.2"></circle><circle cx="654.5" cy="76.5" r="6.2"></circle><circle cx="654.5" cy="93.5" r="6.2"></circle><circle cx="654.5" cy="110.5" r="6.2"></circle><circle cx="654.5" cy="127.5" r="6.2"></circle><circle cx="654.5" cy="144.5" r="6.2"></circle><circle cx="654.5" cy="161.5" r="6.2"></circle><circle cx="654.5" cy="178.5" r="6.2"></circle><circle cx="654.5" cy="195.5" r="6.2"></circle><circle cx="654.5" cy="212.5" r="6.2"></circle><circle cx="654.5" cy="229.5" r="6.2"></circle><circle cx="654.5" cy="246.5" r="6.2"></circle><circle cx="654.5" cy="263.5" r="6.2"></circle><circle cx="654.5" cy="280.5" r="6.2"></circle><circle cx="654.5" cy="297.5" r="6.2"></circle><circle cx="654.5" cy="314.5" r="6.2"></circle><circle cx="654.5" cy="331.5" r="6.2"></circle><circle cx="654.5" cy="348.5" r="6.2"></circle><circle cx="671.5" cy="8.5" r="6.2"></circle><circle cx="671.5" cy="25.5" r="6.2"></circle><circle cx="671.5" cy="42.5" r="6.2"></circle><circle cx="671.5" cy="59.5" r="6.2"></circle><circle cx="671.5" cy="76.5" r="6.2"></circle><circle cx="671.5" cy="93.5" r="6.2"></circle><circle cx="671.5" cy="110.5" r="6.2"></circle><circle cx="671.5" cy="127.5" r="6.2"></circle><circle cx="671.5" cy="144.5" r="6.2"></circle><circle cx="671.5" cy="161.5" r="6.2"></circle><circle cx="671.5" cy="178.5" r="6.2"></circle><circle cx="671.5" cy="195.5" r="6.2"></circle><circle cx="671.5" cy="212.5" r="6.2"></circle><circle cx="671.5" cy="229.5" r="6.2"></circle><circle cx="671.5" cy="246.5" r="6.2"></circle><circle cx="671.5" cy="263.5" r="6.2"></circle><circle cx="671.5" cy="280.5" r="6.2"></circle><circle cx="671.5" cy="297.5" r="6.2"></circle><circle cx="671.5" cy="314.5" r="6.2"></circle><circle cx="671.5" cy="331.5" r="6.2"></circle><circle cx="671.5" cy="348.5" r="6.2"></circle><circle cx="688.5" cy="8.5" r="6.2"></circle><circle cx="688.5" cy="25.5" r="6.2"></circle><circle cx="688.5" cy="42.5" r="6.2"></circle><circle cx="688.5" cy="59.5" r="6.2"></circle><circle cx="688.5" cy="76.5" r="6.2"></circle><circle cx="688.5" cy="93.5" r="6.2"></circle><circle cx="688.5" cy="110.5" r="6.2"></circle><circle cx="688.5" cy="127.5" r="6.2"></circle><circle cx="688.5" cy="144.5" r="6.2"></circle><circle cx="688.5" cy="161.5" r="6.2"></circle><circle cx="688.5" cy="178.5" r="6.2"></circle><circle cx="688.5" cy="195.5" r="6.2"></circle><circle cx="688.5" cy="212.5" r="6.2"></circle><circle cx="688.5" cy="229.5" r="6.2"></circle><circle cx="688.5" cy="246.5" r="6.2"></circle><circle cx="688.5" cy="263.5" r="6.2"></circle><circle cx="688.5" cy="280.5" r="6.2"></circle><circle cx="688.5" cy="297.5" r="6.2"></circle><circle cx="688.5" cy="314.5" r="6.2"></circle><circle cx="688.5" cy="331.5" r="6.2"></circle><circle cx="688.5" cy="348.5" r="6.2"></circle><circle cx="705.5" cy="8.5" r="6.2"></circle><circle cx="705.5" cy="25.5" r="6.2"></circle><circle cx="705.5" cy="42.5" r="6.2"></circle><circle cx="705.5" cy="59.5" r="6.2"></circle><circle cx="705.5" cy="76.5" r="6.2"></circle><circle cx="705.5" cy="93.5" r="6.2"></circle><circle cx="705.5" cy="110.5" r="6.2"></circle><circle cx="705.5" cy="127.5" r="6.2"></circle><circle cx="705.5" cy="144.5" r="6.2"></circle><circle cx="705.5" cy="161.5" r="6.2"></circle><circle cx="705.5" cy="178.5" r="6.2"></circle><circle cx="705.5" cy="195.5" r="6.2"></circle><circle cx="705.5" cy="212.5" r="6.2"></circle><circle cx="705.5" cy="229.5" r="6.2"></circle><circle cx="705.5" cy="246.5" r="6.2"></circle><circle cx="705.5" cy="263.5" r="6.2"></circle><circle cx="705.5" cy="280.5" r="6.2"></circle><circle cx="705.5" cy="297.5" r="6.2"></circle><circle cx="705.5" cy="314.5" r="6.2"></circle><circle cx="705.5" cy="331.5" r="6.2"></circle><circle cx="705.5" cy="348.5" r="6.2"></circle><circle cx="722.5" cy="8.5" r="6.2"></circle><circle cx="722.5" cy="25.5" r="6.2"></circle><circle cx="722.5" cy="42.5" r="6.2"></circle><circle cx="722.5" cy="59.5" r="6.2"></circle><circle cx="722.5" cy="76.5" r="6.2"></circle><circle cx="722.5" cy="93.5" r="6.2"></circle><circle cx="722.5" cy="110.5" r="6.2"></circle><circle cx="722.5" cy="127.5" r="6.2"></circle><circle cx="722.5" cy="144.5" r="6.2"></circle><circle cx="722.5" cy="161.5" r="6.2"></circle><circle cx="722.5" cy="178.5" r="6.2"></circle><circle cx="722.5" cy="195.5" r="6.2"></circle><circle cx="722.5" cy="212.5" r="6.2"></circle><circle cx="722.5" cy="229.5" r="6.2"></circle><circle cx="722.5" cy="246.5" r="6.2"></circle><circle cx="722.5" cy="263.5" r="6.2"></circle><circle cx="722.5" cy="280.5" r="6.2"></circle><circle cx="722.5" cy="297.5" r="6.2"></circle><circle cx="722.5" cy="314.5" r="6.2"></circle><circle cx="722.5" cy="331.5" r="6.2"></circle><circle cx="722.5" cy="348.5" r="6.2"></circle><circle cx="739.5" cy="8.5" r="6.2"></circle><circle cx="739.5" cy="25.5" r="6.2"></circle><circle cx="739.5" cy="42.5" r="6.2"></circle><circle cx="739.5" cy="59.5" r="6.2"></circle><circle cx="739.5" cy="76.5" r="6.2"></circle><circle cx="739.5" cy="93.5" r="6.2"></circle><circle cx="739.5" cy="110.5" r="6.2"></circle><circle cx="739.5" cy="127.5" r="6.2"></circle><circle cx="739.5" cy="144.5" r="6.2"></circle><circle cx="739.5" cy="161.5" r="6.2"></circle><circle cx="739.5" cy="178.5" r="6.2"></circle><circle cx="739.5" cy="195.5" r="6.2"></circle><circle cx="739.5" cy="212.5" r="6.2"></circle><circle cx="739.5" cy="229.5" r="6.2"></circle><circle cx="739.5" cy="246.5" r="6.2"></circle><circle cx="739.5" cy="263.5" r="6.2"></circle><circle cx="739.5" cy="280.5" r="6.2"></circle><circle cx="739.5" cy="297.5" r="6.2"></circle><circle cx="739.5" cy="314.5" r="6.2"></circle><circle cx="739.5" cy="331.5" r="6.2"></circle><circle cx="739.5" cy="348.5" r="6.2"></circle><circle cx="756.5" cy="8.5" r="6.2"></circle><circle cx="756.5" cy="25.5" r="6.2"></circle><circle cx="756.5" cy="42.5" r="6.2"></circle><circle cx="756.5" cy="59.5" r="6.2"></circle><circle cx="756.5" cy="76.5" r="6.2"></circle><circle cx="756.5" cy="93.5" r="6.2"></circle><circle cx="756.5" cy="110.5" r="6.2"></circle><circle cx="756.5" cy="127.5" r="6.2"></circle><circle cx="756.5" cy="144.5" r="6.2"></circle><circle cx="756.5" cy="161.5" r="6.2"></circle><circle cx="756.5" cy="178.5" r="6.2"></circle><circle cx="756.5" cy="195.5" r="6.2"></circle><circle cx="756.5" cy="212.5" r="6.2"></circle><circle cx="756.5" cy="229.5" r="6.2"></circle><circle cx="756.5" cy="246.5" r="6.2"></circle><circle cx="756.5" cy="263.5" r="6.2"></circle><circle cx="756.5" cy="280.5" r="6.2"></circle><circle cx="756.5" cy="297.5" r="6.2"></circle><circle cx="756.5" cy="314.5" r="6.2"></circle><circle cx="756.5" cy="331.5" r="6.2"></circle><circle cx="756.5" cy="348.5" r="6.2"></circle><circle cx="773.5" cy="8.5" r="6.2"></circle><circle cx="773.5" cy="25.5" r="6.2"></circle><circle cx="773.5" cy="42.5" r="6.2"></circle><circle cx="773.5" cy="59.5" r="6.2"></circle><circle cx="773.5" cy="76.5" r="6.2"></circle><circle cx="773.5" cy="93.5" r="6.2"></circle><circle cx="773.5" cy="110.5" r="6.2"></circle><circle cx="773.5" cy="127.5" r="6.2"></circle><circle cx="773.5" cy="144.5" r="6.2"></circle><circle cx="773.5" cy="161.5" r="6.2"></circle><circle cx="773.5" cy="178.5" r="6.2"></circle><circle cx="773.5" cy="195.5" r="6.2"></circle><circle cx="773.5" cy="212.5" r="6.2"></circle><circle cx="773.5" cy="229.5" r="6.2"></circle><circle cx="773.5" cy="246.5" r="6.2"></circle><circle cx="773.5" cy="263.5" r="6.2"></circle><circle cx="773.5" cy="280.5" r="6.2"></circle><circle cx="773.5" cy="297.5" r="6.2"></circle><circle cx="773.5" cy="314.5" r="6.2"></circle><circle cx="773.5" cy="331.5" r="6.2"></circle><circle cx="773.5" cy="348.5" r="6.2"></circle><circle cx="790.5" cy="8.5" r="6.2"></circle><circle cx="790.5" cy="25.5" r="6.2"></circle><circle cx="790.5" cy="42.5" r="6.2"></circle><circle cx="790.5" cy="59.5" r="6.2"></circle><circle cx="790.5" cy="76.5" r="6.2"></circle><circle cx="790.5" cy="93.5" r="6.2"></circle><circle cx="790.5" cy="110.5" r="6.2"></circle><circle cx="790.5" cy="127.5" r="6.2"></circle><circle cx="790.5" cy="144.5" r="6.2"></circle><circle cx="790.5" cy="161.5" r="6.2"></circle><circle cx="790.5" cy="178.5" r="6.2"></circle><circle cx="790.5" cy="195.5" r="6.2"></circle><circle cx="790.5" cy="212.5" r="6.2"></circle><circle cx="790.5" cy="229.5" r="6.2"></circle><circle cx="790.5" cy="246.5" r="6.2"></circle><circle cx="790.5" cy="263.5" r="6.2"></circle><circle cx="790.5" cy="280.5" r="6.2"></circle><circle cx="790.5" cy="297.5" r="6.2"></circle><circle cx="790.5" cy="314.5" r="6.2"></circle><circle cx="790.5" cy="331.5" r="6.2"></circle><circle cx="790.5" cy="348.5" r="6.2"></circle><circle cx="807.5" cy="8.5" r="6.2"></circle><circle cx="807.5" cy="25.5" r="6.2"></circle><circle cx="807.5" cy="42.5" r="6.2"></circle><circle cx="807.5" cy="59.5" r="6.2"></circle><circle cx="807.5" cy="76.5" r="6.2"></circle><circle cx="807.5" cy="93.5" r="6.2"></circle><circle cx="807.5" cy="110.5" r="6.2"></circle><circle cx="807.5" cy="127.5" r="6.2"></circle><circle cx="807.5" cy="144.5" r="6.2"></circle><circle cx="807.5" cy="161.5" r="6.2"></circle><circle cx="807.5" cy="178.5" r="6.2"></circle><circle cx="807.5" cy="195.5" r="6.2"></circle><circle cx="807.5" cy="212.5" r="6.2"></circle><circle cx="807.5" cy="229.5" r="6.2"></circle><circle cx="807.5" cy="246.5" r="6.2"></circle><circle cx="807.5" cy="263.5" r="6.2"></circle><circle cx="807.5" cy="280.5" r="6.2"></circle><circle cx="807.5" cy="297.5" r="6.2"></circle><circle cx="807.5" cy="314.5" r="6.2"></circle><circle cx="807.5" cy="331.5" r="6.2"></circle><circle cx="807.5" cy="348.5" r="6.2"></circle><circle cx="824.5" cy="8.5" r="6.2"></circle><circle cx="824.5" cy="25.5" r="6.2"></circle><circle cx="824.5" cy="42.5" r="6.2"></circle><circle cx="824.5" cy="59.5" r="6.2"></circle><circle cx="824.5" cy="76.5" r="6.2"></circle><circle cx="824.5" cy="93.5" r="6.2"></circle><circle cx="824.5" cy="110.5" r="6.2"></circle><circle cx="824.5" cy="127.5" r="6.2"></circle><circle cx="824.5" cy="144.5" r="6.2"></circle><circle cx="824.5" cy="161.5" r="6.2"></circle><circle cx="824.5" cy="178.5" r="6.2"></circle><circle cx="824.5" cy="195.5" r="6.2"></circle><circle cx="824.5" cy="212.5" r="6.2"></circle><circle cx="824.5" cy="229.5" r="6.2"></circle><circle cx="824.5" cy="246.5" r="6.2"></circle><circle cx="824.5" cy="263.5" r="6.2"></circle><circle cx="824.5" cy="280.5" r="6.2"></circle><circle cx="824.5" cy="297.5" r="6.2"></circle><circle cx="824.5" cy="314.5" r="6.2"></circle><circle cx="824.5" cy="331.5" r="6.2"></circle><circle cx="824.5" cy="348.5" r="6.2"></circle><circle cx="841.5" cy="8.5" r="6.2"></circle><circle cx="841.5" cy="25.5" r="6.2"></circle><circle cx="841.5" cy="42.5" r="6.2"></circle><circle cx="841.5" cy="59.5" r="6.2"></circle><circle cx="841.5" cy="76.5" r="6.2"></circle><circle cx="841.5" cy="93.5" r="6.2"></circle><circle cx="841.5" cy="110.5" r="6.2"></circle><circle cx="841.5" cy="127.5" r="6.2"></circle><circle cx="841.5" cy="144.5" r="6.2"></circle><circle cx="841.5" cy="161.5" r="6.2"></circle><circle cx="841.5" cy="178.5" r="6.2"></circle><circle cx="841.5" cy="195.5" r="6.2"></circle><circle cx="841.5" cy="212.5" r="6.2"></circle><circle cx="841.5" cy="229.5" r="6.2"></circle><circle cx="841.5" cy="246.5" r="6.2"></circle><circle cx="841.5" cy="263.5" r="6.2"></circle><circle cx="841.5" cy="280.5" r="6.2"></circle><circle cx="841.5" cy="297.5" r="6.2"></circle><circle cx="841.5" cy="314.5" r="6.2"></circle><circle cx="841.5" cy="331.5" r="6.2"></circle><circle cx="841.5" cy="348.5" r="6.2"></circle></g><g data-tip="136 clean complete recoveries" fill="var(--c4s-ok)"><circle cx="59.5" cy="229.5" r="6.2"></circle><circle cx="59.5" cy="246.5" r="6.2"></circle><circle cx="59.5" cy="263.5" r="6.2"></circle><circle cx="59.5" cy="280.5" r="6.2"></circle><circle cx="59.5" cy="297.5" r="6.2"></circle><circle cx="59.5" cy="314.5" r="6.2"></circle><circle cx="59.5" cy="331.5" r="6.2"></circle><circle cx="59.5" cy="348.5" r="6.2"></circle><circle cx="76.5" cy="8.5" r="6.2"></circle><circle cx="76.5" cy="25.5" r="6.2"></circle><circle cx="76.5" cy="42.5" r="6.2"></circle><circle cx="76.5" cy="59.5" r="6.2"></circle><circle cx="76.5" cy="76.5" r="6.2"></circle><circle cx="76.5" cy="93.5" r="6.2"></circle><circle cx="76.5" cy="110.5" r="6.2"></circle><circle cx="76.5" cy="127.5" r="6.2"></circle><circle cx="76.5" cy="144.5" r="6.2"></circle><circle cx="76.5" cy="161.5" r="6.2"></circle><circle cx="76.5" cy="178.5" r="6.2"></circle><circle cx="76.5" cy="195.5" r="6.2"></circle><circle cx="76.5" cy="212.5" r="6.2"></circle><circle cx="76.5" cy="229.5" r="6.2"></circle><circle cx="76.5" cy="246.5" r="6.2"></circle><circle cx="76.5" cy="263.5" r="6.2"></circle><circle cx="76.5" cy="280.5" r="6.2"></circle><circle cx="76.5" cy="297.5" r="6.2"></circle><circle cx="76.5" cy="314.5" r="6.2"></circle><circle cx="76.5" cy="331.5" r="6.2"></circle><circle cx="76.5" cy="348.5" r="6.2"></circle><circle cx="93.5" cy="8.5" r="6.2"></circle><circle cx="93.5" cy="25.5" r="6.2"></circle><circle cx="93.5" cy="42.5" r="6.2"></circle><circle cx="93.5" cy="59.5" r="6.2"></circle><circle cx="93.5" cy="76.5" r="6.2"></circle><circle cx="93.5" cy="93.5" r="6.2"></circle><circle cx="93.5" cy="110.5" r="6.2"></circle><circle cx="93.5" cy="127.5" r="6.2"></circle><circle cx="93.5" cy="144.5" r="6.2"></circle><circle cx="93.5" cy="161.5" r="6.2"></circle><circle cx="93.5" cy="178.5" r="6.2"></circle><circle cx="93.5" cy="195.5" r="6.2"></circle><circle cx="93.5" cy="212.5" r="6.2"></circle><circle cx="93.5" cy="229.5" r="6.2"></circle><circle cx="93.5" cy="246.5" r="6.2"></circle><circle cx="93.5" cy="263.5" r="6.2"></circle><circle cx="93.5" cy="280.5" r="6.2"></circle><circle cx="93.5" cy="297.5" r="6.2"></circle><circle cx="93.5" cy="314.5" r="6.2"></circle><circle cx="93.5" cy="331.5" r="6.2"></circle><circle cx="93.5" cy="348.5" r="6.2"></circle><circle cx="110.5" cy="8.5" r="6.2"></circle><circle cx="110.5" cy="25.5" r="6.2"></circle><circle cx="110.5" cy="42.5" r="6.2"></circle><circle cx="110.5" cy="59.5" r="6.2"></circle><circle cx="110.5" cy="76.5" r="6.2"></circle><circle cx="110.5" cy="93.5" r="6.2"></circle><circle cx="110.5" cy="110.5" r="6.2"></circle><circle cx="110.5" cy="127.5" r="6.2"></circle><circle cx="110.5" cy="144.5" r="6.2"></circle><circle cx="110.5" cy="161.5" r="6.2"></circle><circle cx="110.5" cy="178.5" r="6.2"></circle><circle cx="110.5" cy="195.5" r="6.2"></circle><circle cx="110.5" cy="212.5" r="6.2"></circle><circle cx="110.5" cy="229.5" r="6.2"></circle><circle cx="110.5" cy="246.5" r="6.2"></circle><circle cx="110.5" cy="263.5" r="6.2"></circle><circle cx="110.5" cy="280.5" r="6.2"></circle><circle cx="110.5" cy="297.5" r="6.2"></circle><circle cx="110.5" cy="314.5" r="6.2"></circle><circle cx="110.5" cy="331.5" r="6.2"></circle><circle cx="110.5" cy="348.5" r="6.2"></circle><circle cx="127.5" cy="8.5" r="6.2"></circle><circle cx="127.5" cy="25.5" r="6.2"></circle><circle cx="127.5" cy="42.5" r="6.2"></circle><circle cx="127.5" cy="59.5" r="6.2"></circle><circle cx="127.5" cy="76.5" r="6.2"></circle><circle cx="127.5" cy="93.5" r="6.2"></circle><circle cx="127.5" cy="110.5" r="6.2"></circle><circle cx="127.5" cy="127.5" r="6.2"></circle><circle cx="127.5" cy="144.5" r="6.2"></circle><circle cx="127.5" cy="161.5" r="6.2"></circle><circle cx="127.5" cy="178.5" r="6.2"></circle><circle cx="127.5" cy="195.5" r="6.2"></circle><circle cx="127.5" cy="212.5" r="6.2"></circle><circle cx="127.5" cy="229.5" r="6.2"></circle><circle cx="127.5" cy="246.5" r="6.2"></circle><circle cx="127.5" cy="263.5" r="6.2"></circle><circle cx="127.5" cy="280.5" r="6.2"></circle><circle cx="127.5" cy="297.5" r="6.2"></circle><circle cx="127.5" cy="314.5" r="6.2"></circle><circle cx="127.5" cy="331.5" r="6.2"></circle><circle cx="127.5" cy="348.5" r="6.2"></circle><circle cx="144.5" cy="8.5" r="6.2"></circle><circle cx="144.5" cy="25.5" r="6.2"></circle><circle cx="144.5" cy="42.5" r="6.2"></circle><circle cx="144.5" cy="59.5" r="6.2"></circle><circle cx="144.5" cy="76.5" r="6.2"></circle><circle cx="144.5" cy="93.5" r="6.2"></circle><circle cx="144.5" cy="110.5" r="6.2"></circle><circle cx="144.5" cy="127.5" r="6.2"></circle><circle cx="144.5" cy="144.5" r="6.2"></circle><circle cx="144.5" cy="161.5" r="6.2"></circle><circle cx="144.5" cy="178.5" r="6.2"></circle><circle cx="144.5" cy="195.5" r="6.2"></circle><circle cx="144.5" cy="212.5" r="6.2"></circle><circle cx="144.5" cy="229.5" r="6.2"></circle><circle cx="144.5" cy="246.5" r="6.2"></circle><circle cx="144.5" cy="263.5" r="6.2"></circle><circle cx="144.5" cy="280.5" r="6.2"></circle><circle cx="144.5" cy="297.5" r="6.2"></circle><circle cx="144.5" cy="314.5" r="6.2"></circle><circle cx="144.5" cy="331.5" r="6.2"></circle><circle cx="144.5" cy="348.5" r="6.2"></circle><circle cx="161.5" cy="8.5" r="6.2"></circle><circle cx="161.5" cy="25.5" r="6.2"></circle><circle cx="161.5" cy="42.5" r="6.2"></circle><circle cx="161.5" cy="59.5" r="6.2"></circle><circle cx="161.5" cy="76.5" r="6.2"></circle><circle cx="161.5" cy="93.5" r="6.2"></circle><circle cx="161.5" cy="110.5" r="6.2"></circle><circle cx="161.5" cy="127.5" r="6.2"></circle><circle cx="161.5" cy="144.5" r="6.2"></circle><circle cx="161.5" cy="161.5" r="6.2"></circle><circle cx="161.5" cy="178.5" r="6.2"></circle><circle cx="161.5" cy="195.5" r="6.2"></circle><circle cx="161.5" cy="212.5" r="6.2"></circle><circle cx="161.5" cy="229.5" r="6.2"></circle><circle cx="161.5" cy="246.5" r="6.2"></circle><circle cx="161.5" cy="263.5" r="6.2"></circle><circle cx="161.5" cy="280.5" r="6.2"></circle><circle cx="161.5" cy="297.5" r="6.2"></circle><circle cx="161.5" cy="314.5" r="6.2"></circle><circle cx="161.5" cy="331.5" r="6.2"></circle><circle cx="161.5" cy="348.5" r="6.2"></circle><circle cx="178.5" cy="8.5" r="6.2"></circle><circle cx="178.5" cy="25.5" r="6.2"></circle></g><g data-tip="76 complete recoveries that also changed something else" fill="var(--c4s-hot)"><circle cx="8.5" cy="8.5" r="6.2"></circle><circle cx="8.5" cy="25.5" r="6.2"></circle><circle cx="8.5" cy="42.5" r="6.2"></circle><circle cx="8.5" cy="59.5" r="6.2"></circle><circle cx="8.5" cy="76.5" r="6.2"></circle><circle cx="8.5" cy="93.5" r="6.2"></circle><circle cx="8.5" cy="110.5" r="6.2"></circle><circle cx="8.5" cy="127.5" r="6.2"></circle><circle cx="8.5" cy="144.5" r="6.2"></circle><circle cx="8.5" cy="161.5" r="6.2"></circle><circle cx="8.5" cy="178.5" r="6.2"></circle><circle cx="8.5" cy="195.5" r="6.2"></circle><circle cx="8.5" cy="212.5" r="6.2"></circle><circle cx="8.5" cy="229.5" r="6.2"></circle><circle cx="8.5" cy="246.5" r="6.2"></circle><circle cx="8.5" cy="263.5" r="6.2"></circle><circle cx="8.5" cy="280.5" r="6.2"></circle><circle cx="8.5" cy="297.5" r="6.2"></circle><circle cx="8.5" cy="314.5" r="6.2"></circle><circle cx="8.5" cy="331.5" r="6.2"></circle><circle cx="8.5" cy="348.5" r="6.2"></circle><circle cx="25.5" cy="8.5" r="6.2"></circle><circle cx="25.5" cy="25.5" r="6.2"></circle><circle cx="25.5" cy="42.5" r="6.2"></circle><circle cx="25.5" cy="59.5" r="6.2"></circle><circle cx="25.5" cy="76.5" r="6.2"></circle><circle cx="25.5" cy="93.5" r="6.2"></circle><circle cx="25.5" cy="110.5" r="6.2"></circle><circle cx="25.5" cy="127.5" r="6.2"></circle><circle cx="25.5" cy="144.5" r="6.2"></circle><circle cx="25.5" cy="161.5" r="6.2"></circle><circle cx="25.5" cy="178.5" r="6.2"></circle><circle cx="25.5" cy="195.5" r="6.2"></circle><circle cx="25.5" cy="212.5" r="6.2"></circle><circle cx="25.5" cy="229.5" r="6.2"></circle><circle cx="25.5" cy="246.5" r="6.2"></circle><circle cx="25.5" cy="263.5" r="6.2"></circle><circle cx="25.5" cy="280.5" r="6.2"></circle><circle cx="25.5" cy="297.5" r="6.2"></circle><circle cx="25.5" cy="314.5" r="6.2"></circle><circle cx="25.5" cy="331.5" r="6.2"></circle><circle cx="25.5" cy="348.5" r="6.2"></circle><circle cx="42.5" cy="8.5" r="6.2"></circle><circle cx="42.5" cy="25.5" r="6.2"></circle><circle cx="42.5" cy="42.5" r="6.2"></circle><circle cx="42.5" cy="59.5" r="6.2"></circle><circle cx="42.5" cy="76.5" r="6.2"></circle><circle cx="42.5" cy="93.5" r="6.2"></circle><circle cx="42.5" cy="110.5" r="6.2"></circle><circle cx="42.5" cy="127.5" r="6.2"></circle><circle cx="42.5" cy="144.5" r="6.2"></circle><circle cx="42.5" cy="161.5" r="6.2"></circle><circle cx="42.5" cy="178.5" r="6.2"></circle><circle cx="42.5" cy="195.5" r="6.2"></circle><circle cx="42.5" cy="212.5" r="6.2"></circle><circle cx="42.5" cy="229.5" r="6.2"></circle><circle cx="42.5" cy="246.5" r="6.2"></circle><circle cx="42.5" cy="263.5" r="6.2"></circle><circle cx="42.5" cy="280.5" r="6.2"></circle><circle cx="42.5" cy="297.5" r="6.2"></circle><circle cx="42.5" cy="314.5" r="6.2"></circle><circle cx="42.5" cy="331.5" r="6.2"></circle><circle cx="42.5" cy="348.5" r="6.2"></circle><circle cx="59.5" cy="8.5" r="6.2"></circle><circle cx="59.5" cy="25.5" r="6.2"></circle><circle cx="59.5" cy="42.5" r="6.2"></circle><circle cx="59.5" cy="59.5" r="6.2"></circle><circle cx="59.5" cy="76.5" r="6.2"></circle><circle cx="59.5" cy="93.5" r="6.2"></circle><circle cx="59.5" cy="110.5" r="6.2"></circle><circle cx="59.5" cy="127.5" r="6.2"></circle><circle cx="59.5" cy="144.5" r="6.2"></circle><circle cx="59.5" cy="161.5" r="6.2"></circle><circle cx="59.5" cy="178.5" r="6.2"></circle><circle cx="59.5" cy="195.5" r="6.2"></circle><circle cx="59.5" cy="212.5" r="6.2"></circle></g></svg><figcaption>One dot per Image-to-Scene evaluation (paper Figure 6c).</figcaption></figure></div></div></div></section><section class="dark" id="citation"><div class="container"> | |
| <div class="section-header centered"><span class="section-label">Citation</span><h2 class="section-title">Cite This Work</h2></div> | |
| <div class="cite-box"><button class="cite-copy-btn" id="copy-btn">Copy</button><pre id="bibtex-text">@misc{ye2026code4scene, | |
| title = {Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes}, | |
| author = {Xiaokang Ye and Siddhant Hitesh Mantri and Zimeng Chen and Edward Zhang and Zhaoxu Zheng and Yuanheng Li and Yizhao Chen and Tianyang Huang and Lianhui Qin}, | |
| year = {2026}, | |
| eprint = {2609.36777}, | |
| archivePrefix = {arXiv}, | |
| primaryClass = {cs.AI}, | |
| url = {https://arxiv.org/abs/2609.36777}, | |
| }</pre></div> | |
| <div style="display:flex;flex-wrap:wrap;gap:1rem;justify-content:center;margin-top:2rem"> | |
| <a class="btn btn-outline" href="https://arxiv.org/abs/2609.36777" rel="noopener" target="_blank"><svg aria-hidden="true" fill="currentColor" viewbox="0 0 16 16"><path d="M4 0h5.5L14 4.5V14a2 2 0 01-2 2H4a2 2 0 01-2-2V2a2 2 0 012-2zm5 1.5V5h3.5L9 1.5zM5 8h6v1H5zm0 2.5h6v1H5z"></path></svg> arXiv</a> | |
| <a class="btn btn-outline" href="https://github.com/SimWorld-AI/Code4Scene" rel="noopener" target="_blank"><svg aria-hidden="true" fill="currentColor" viewbox="0 0 16 16"><path d="M8 0C3.58 0 0 3.58 0 8c0 3.54 2.29 6.53 5.47 7.59.4.07.55-.17.55-.38 0-.19-.01-.82-.01-1.49-2.01.37-2.53-.49-2.69-.94-.09-.23-.48-.94-.82-1.13-.28-.15-.68-.52-.01-.53.63-.01 1.08.58 1.23.82.72 1.21 1.87.87 2.33.66.07-.52.28-.87.51-1.07-1.78-.2-3.64-.89-3.64-3.95 0-.87.31-1.59.82-2.15-.08-.2-.36-1.02.08-2.12 0 0 .67-.21 2.2.82.64-.18 1.32-.27 2-.27.68 0 1.36.09 2 .27 1.53-1.04 2.2-.82 2.2-.82.44 1.1.16 1.92.08 2.12.51.56.82 1.27.82 2.15 0 3.07-1.87 3.75-3.65 3.95.29.25.54.73.54 1.48 0 1.07-.01 1.93-.01 2.2 0 .21.15.46.55.38A8.013 8.013 0 0016 8c0-4.42-3.58-8-8-8z"></path></svg> GitHub Repository</a> | |
| <a class="btn btn-outline" href="https://simworld.org/" rel="noopener" target="_blank">SimWorld Main Site</a></div> | |
| </div></section></main> | |
| <footer><p>Code4Scene · UC San Diego & UC Berkeley · <a href="https://arxiv.org/abs/2609.36777" rel="noopener" target="_blank">arXiv:2609.36777</a> · <a href="https://github.com/SimWorld-AI/Code4Scene" rel="noopener" target="_blank">GitHub</a> · | |
| <a href="https://simworld.org/" rel="noopener" target="_blank">SimWorld Home</a></p> | |
| <p style="margin-top:.5rem;font-size:.75rem;color:rgba(255,255,255,.25)">Part of the SimWorld project.</p></footer> | |
| <script src="assets/paper.js?v=5427505a"></script> | |
| <script defer="" src="assets/leaderboard-bars.js?v=20261004i2s"></script><script src="data/site.js?v=20261004i2smore"></script><script src="assets/pareto.js?v=20261004i2s" type="module"></script><script src="assets/scene-cards.js?v=20261004harborlive" type="module"></script><script src="assets/task-tabs.js?v=20261001c" type="module"></script><script src="assets/leaderboard-controls.js?v=20261001c" type="module"></script><script src="assets/takeaway-bars.js?v=20261004kit" type="module"></script></body></html> |