mindformers.models.bert.BertModel

class mindformers.models.bert.BertModel(config=None, is_training=False, use_one_hot_embeddings=False)

Bidirectional Encoder Representations from Transformers.

参数

• config (Class) – Configuration for BertModel.

• is_training (bool) – True for training mode. False for eval mode.

• use_one_hot_embeddings (bool) – Specifies whether to use one hot encoding form. Default: False.