BERT

BERT 的两阶段如下所示：

Comparision Of Models

---

参考

• A Neural Probabilistic Language Model
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding