Bert

About

BERT is designed to pre-train deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers.

Key Features

• Bidirectional Training
• Transformer Architecture
• Pre-trained on large datasets

Pros

• High accuracy on NLP tasks
• Pre-trained models available

Cons

• High computational cost 💸
• Large model size