Anthropic 提出 Model Spec 中间训练(MSM)以改进对齐训练的泛化
Model Spec Midtraining: Improving How Alignment Training Generalizes
AI 导读Anthropic 提出 model spec midtraining(MSM),在预训练后、对齐微调前用讨论 Model Spec 的合成文档训练模型,塑造后续对齐训练的泛化方式。
来源:Anthropic:Alignment Science Blog · alignment.anthropic.com