Papers
arxiv:2610.40754

DyCraft: An Agentic System for Long-Horizon 4D Scene Generation

Published on Oct 29
· Submitted by
Jeff Tan
on Nov 11
Authors:
,
,
,
,
,
,
,

Abstract

DyCraft improves long-horizon 3D animation by decomposing it into planned static scenes, keyframe storyboards, and local motion authoring to reduce physical errors.

While frontier coding agents can generate high-quality 3D scenes and articulated assets, they struggle to create coherent long-horizon animations. When equipped with general-purpose harnesses, they frequently produce physically implausible outputs, generating objects that interpenetrate, lack physical support, or move unnaturally. Such bare agents struggle to repair these errors because they default to scripting the full animation in one pass, making it difficult to verify their work and disentangle complex spatiotemporal constraints. Drawing on the practice of human animators, we introduce DyCraft, a system for animated 3D scene generation that breaks animation into steps that coding agents can more reliably solve. DyCraft first expands the user's prompt into a detailed plan and builds a static scene. It then creates a 3D storyboard of key animation poses, where each frame is a static 3D scene that the agent can build and debug in isolation. Storyboarding decomposes the problem into pairs of verified start and end states, allowing the agent to author local motion between them with a collection of motion authoring tools. We evaluate DyCraft on 24 long-horizon, multi-shot animation tasks covering humanoid robots, human and animal characters, and physical mechanisms. Compared with a native GPT-6 agent in Codex and prior agentic baselines, DyCraft substantially reduces physical violations and generates higher-quality animated 3D scenes that are more often preferred by human raters.

Community

Paper submitter

We use GPT-6-Astra to build minute-long 3D Blender animations from text prompts, each dozens of shots with realistic motions of people, humanoid robots, animals, and mechanisms.

Introducing DyCraft!

Check out more results on our project page, including a 3D interactive viewer for all 24 scenes!
Project page: https://dy-craft.github.io/
Github: https://github.com/jefftan969/dycraft
Paper: https://arxiv.org/abs/2610.40754

Having the agent build a 3D storyboard of verified start and end poses before authoring the motion between them is how I would want animation work checked: small pieces I can debug in isolation. How did it cope with scenes where several characters' motions depend on each other?

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.40754
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.40754 in a model README.md to link it from this page.

Datasets citing this paper 2

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.40754 in a Space README.md to link it from this page.

Collections including this paper 1