Creative Coding

3DCodeVerse Treats 3D Scenes as Programs, Not Meshes — Two Million of Them, Licensed Non-Commercially

A 19-author preprint bets that the right representation for machine-made 3D is executable code: editable, verifiable, diffable. The dataset is CC BY-NC-SA 4.0, so you can learn from it but not sell from it.

3DCodeVerse: Exploring 3D Worlds as Code was posted to arXiv on 15 October 2026 (arXiv:2610.22341) by Yipeng Gao, Ziyao Zeng, Jinfa Huang and sixteen co-authors, filed under cs.CV and cs.AI. The paper carries no Comments field and no journal reference, so this is an unreviewed preprint.

The premise will be immediately familiar to anyone who writes generative work in code, and it is worth stating in their terms before the machine-learning framing arrives.

The argument

There are two ways to make a 3D thing. You can produce the geometry — a mesh, a point cloud, a splat — or you can produce the program that produces the geometry. The first is an output. The second is an artefact you can read, edit, parameterise, diff, re-run with different numbers and hand to someone else.

Every procedural artist already knows which one they want. Geometry Nodes exists because of this. So does every for loop anyone has written over a grid of cubes. If a machine is going to make 3D content, the paper’s bet is that it should produce the program, for exactly the reasons a human would.

The authors put it as “editable and verifiable 3D content at scale,” and verifiable is doing real work in that sentence. You cannot unit-test a mesh. You can execute a program and check whether it ran.

What they built

Three parts.

1. 3DCodeVerse-2M. A large curated dataset of standalone 3D executable code, assembled three ways: collecting open-source data, converting specialised representations into code, and generating new programs with coding agents. The packaging detail is the one that matters practically — each program ships with “the source files and associated assets required for execution in its declared environment, along with available descriptions and verification records.”

That is an unglamorous engineering decision with large consequences. A corpus of 3D code where half the entries reference a texture nobody shipped is a corpus of 3D code that does not run. Declaring the environment and packaging the assets is what makes the execution check possible in the first place.

The Hugging Face dataset card tags it text-to-3d, image-to-3d, procedural-3d, code-generation, blender and benchmark, in the 10K–100K size category, with the 3d modality.

2. The 3DCodeVerse Harness. A multi-agent directed acyclic graph framework for generating and refining 3D content. Rather than one model emitting one program, the pipeline runs execution checks, spatial measurements and visual feedback to evaluate and revise generated programs — “without human feedback during generation.”

The spatial-measurement step is the interesting one. A program can execute cleanly and still place the chair inside the table. Measuring the resulting scene closes a gap that a compile-succeeds check leaves wide open.

3. Empirical studies. Baselines with fine-tuned open models, and component-level analyses of the harness to work out which parts earn their place. The authors report that fine-tuning on the dataset “significantly improves the 3D coding capabilities of open-source models,” and that the harness achieved a 90% win rate against Claude Design (3D Object) in pairwise human evaluations when both were driven by the same underlying model.

Treat that 90% with the usual care for a preprint reporting its own system’s win rate in its own human evaluation. The claim is specific and falsifiable, which is better than most, but it has not been reviewed and we have not reproduced it.

The licence, and the asymmetry inside it

The dataset is CC BY-NC-SA 4.0. Three clauses, each with teeth:

  • BY — attribute. Fine.
  • NC — no commercial use. A studio cannot fine-tune a production model on this.
  • SA — share-alike. Derivatives inherit the same terms.

Note what that means in combination with the construction method. Part of the corpus came from collecting open-source data — code whose own licences are, in many cases, more permissive than CC BY-NC-SA. Aggregating permissively licensed programs into a non-commercial share-alike dataset is legal and common, but it is a one-way valve: material goes in free to use and comes out restricted, and the restriction propagates to anything trained on it.

So the practical position is this. If you are a researcher, 3DCodeVerse-2M is yours to use. If you are a commercial tool vendor who read the abstract and got excited about fine-tuning, the dataset is a demonstration of what is possible rather than a thing you can ship. The idea — package programs with their assets and declared environment, then verify by executing, measuring and looking — is free, and is the part most worth stealing.

The tracker we run each morning flagged ilabai/3dcodeverse as one of the day’s fastest-growing datasets: +102.5%, from 65,613 to 132,836 downloads in 24 hours, on a dataset created back in June. A dataset doubling four months after creation is a paper landing, not a dataset launching.

What a practitioner should take away

Two things, neither of which requires caring about benchmarks.

First, declared environment plus packaged assets is a format decision you can adopt today in your own work. If every generator you write ships with the exact asset bundle and a stated runtime, your own back catalogue stops rotting.

Second, the execute-measure-look loop is a quality gate you can run without any agents at all. Render a thumbnail, measure the bounding boxes, assert the thing you actually care about. Most procedural work is validated by a human squinting at a viewport; almost none of it has a test.

Sources