mindformers.models.bloom.BloomModel

class mindformers.models.bloom.BloomModel(config)

The backbone of Bloom network

Args:

config(BloomConfig): The config of network

Inputs:

input_ids(Tensor): The tokenized inputs with datatype int32 input_mask(Tensor): The mask indicating whether each position is a valid input

Returns:

output_state(Tensor): The output logit of backbone embedding_table(Tensor): The embedding table for the vocabulary