FLUX.1 Kontext可控灯光开关的LoRA方向提取
原标题:LoRA Direction Extraction for Controllable Light Toggling in FLUX.1 Kontext
AI 摘要
该研究提出一种针对流匹配扩散模型的微调方法,用于在FLUX.1 Kontext中实现可控的室内灯光开关编辑,无需大规模训练数据集。方法将开灯与关灯分解为两个独立任务,分别训练LoRA适配器,并提出LoRA方向提取训练法以提取适配器在扩散模型流场中的纯方向,同时引入专门损失函数保证逆变换的真实性。生成的增量图还可用于更精确地调整光照颜色和色温。
正文节选
LoRA Direction Extraction for Controllable Light Toggling in FLUX.1 Kontext Abstract We propose a fine-tuning method for flow-matching diffusion models aimed at realistic artificial light modeling without the need for a large training dataset. We address the task of controllable interior image editing, where the goal is to turn artificial light sources on or off while preserving the scene geometry, object placement, materials, and visual identity of the original image. To achieve this, we decomp