AI Pulse
📄 论文解读

4B模型跑出1024图,0.59秒一张

大模型生成图片通常又大又慢,但Mage-Flow用4B参数(比主流小一个量级)做到了1024分辨率下0.59秒出图、1.02秒编辑。关键在于它重新设计了三个环节:一个轻量级图像编码器(Mage-VAE)把图片转成更紧凑的表示,成本降低10倍以上;一个原生分辨率扩散模型,不用裁剪缩放;再加上底层CUDA融合优化,训练速度提升2.5倍。最终效果在标准评测中不输大模型,但速度快到可以交互使用。它不是你能直接下载的App,但说明高效小模型也能干大活——未来手机本地跑高清生成不是梦。

📄 原文摘要(英文)

Large-scale visual generators are increasingly capable but costly to train, fine-tune, and deploy. We introduce Mage-Flow, a compact 4B-scale generative stack for efficient text-to-image generation and instruction-based image editing. The stack is built from two co-designed components: Mage-VAE, a lightweight high-fidelity latent tokenizer, and a Native-Resolution Multimodal Diffusion Transformer trained with rectified flow matching. Mage-VAE uses one-step diffusion-style encoding and decoding with anchor-latent regularization, preserving the reconstruction quality of strong public VAEs while reducing tokenization cost by more than an order of magnitude. Together with native-resolution packing and stack-level CUDA kernel fusion, the stack supports flexible-resolution training and improves end-to-end training throughput by about 2.5times. Built on this foundation, we develop a complete model family with Base, RL-aligned, and Turbo variants for both generation and editing. Diffusion-NFT improves prompt following, text rendering, aesthetic quality, and editing fidelity, while few-step distillation with adversarial perceptual guidance produces 4-step Turbo models for low-latency inference. Despite its compact scale, Mage-Flow and Mage-Flow-Edit achieves competitive performance across standard generation and editing benchmarks. More importantly, the Turbo variants make high-resolution generation and editing practical for interactive use: at 1024^2 resolution on a single NVIDIA A100 GPU, Mage-Flow-Turbo generates an image in 0.59s, and Mage-Flow-Edit-Turbo edits an image in 1.02s, while maintaining a small memory footprint. These results show that careful tokenizer--backbone--system co-design can deliver strong high-resolution generation and editing within an efficient 4B model family.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新