mindformers.models.bloom.BloomModel

class mindformers.models.bloom.BloomModel(config)

The backbone of Bloom network

参数

config (BloomConfig) – The config of network

Inputs:

input_ids(Tensor): The tokenized inputs with datatype int32 input_mask(Tensor): The mask indicating whether each position is a valid input

返回

The output logit of backbone embedding_table(Tensor): The embedding table for the vocabulary

返回类型

output_state(Tensor)