Decoded
Feed

UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvement

arXiv:2609.38721AICV30 sep 20261 min readHN ×2PDF

An image model critiques its own pictures, then trains itself to get them right the first time.

0.808

GenEval score (0–1)

GenEval score after self-training

No external teacher or reward model needed for the gain

How it works

  1. Critiques help only once

    A unified model can spot flaws in its own images, but fixing them needs an extra reflection pass every time.

  2. Same model, two roles

    The teacher copy sees a critique-revised prompt; the student sees the original. The student matches the teacher's denoising steps.

  3. Better first drafts

    Direct generation improves on GenEval, GenEval2 and OCR. Reflection still adds gains on top.

generateinspectrewriteteacher contextLoRA updateOriginalpromptDraft imageSelfcritiqueVerifiedrevised promptTeacher-studentmatchingUpdatedgeneratorgenerateinspectrewriteteacher contextLoRA updateOriginalpromptDraft imageSelfcritiqueVerifiedrevised promptTeacher-studentmatchingUpdatedgenerator
From the paper