AI把图片拆成可编辑设计稿,像拆乐高
设计师常遇到一个痛点:拿到一张图片,想改里面的文字、颜色或图层顺序,却只能从头重画。这篇论文的AI能像拆乐高一样,把一张图片自动拆成可编辑的设计文件——包括字体、矢量图形、颜色、分组和图层顺序。它用多个专业工具协作,每拆一步就检查一次,拆错了就重试,避免错误累积。在909个真实Figma文件测试中,它改文字、调颜色、挪布局的成功率都超过现有方法。虽然它不是你明天就能用的工具,但这是AI从“看懂图”到“能改图”的关键一步。
📄 原文摘要(英文)
Recovering an editable design file from a raster image is a common and costly bottleneck in modern design workflows, yet remains challenging since editability depends on recovering multi-modal attributes, such as typography, vector geometry, colors, grouping, and layer ordering. We present ReDesign, an agentic framework that grows an editable layer hierarchy by selecting and composing specialized tools across modalities. To keep this long decision process reliable despite imperfect tool outputs, we introduce graceful verification at each expansion, which provides local accept, prune, or retry feedback that prevents error accumulation and avoids large scale reruns. To evaluate editability at scale, we introduce the Figma Edit Replay Benchmark, consisting of 909 raw Figma files and 14,796 controlled edit instructions that replay edits on reconstructed outputs. Across this benchmark and standard reconstruction metrics, ReDesign achieves strong visual fidelity while delivering the highest editability across layout, color, and text edits, outperforming layered decomposition baselines and serial tool use pipelines.