MemeTAG:基于标签嵌入重建的关键词驱动迷因分类
原标题:MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction
AI 摘要
研究者提出 MemeTAG,一种关键词驱动的双目标多模态框架,用于有害网络迷因分类。该方法先用预训练视觉语言模型生成描述性关键词,再通过聚合标签推理网络(ATIN)将关键词蒸馏为语义嵌入,并以此作为辅助重建损失的目标,促使视觉与文本特征深度对齐。配合三阶段训练策略,MemeTAG 在 HarMeme、Hateful Memes Challenge 和 PrideMM 三个数据集上取得新的最优结果。
正文节选
MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction Abstract The proliferation of harmful internet memes poses a significant societal threat, yet their automated classification remains a formidable algorithmic challenge due to the nuanced, multimodal nature of their content. To address this, we introduce MemeTAG, a novel dual-objective framework that pioneers a keyword-aware approach to meme classification. Our core innovation is a two-part semantic guidance mechanis