mindformers.models.llama.LlamaModel

class mindformers.models.llama.LlamaModel(config: mindformers.models.llama.llama_config.LlamaConfig = None)[源代码]

Transformer decoder consisting of config.num_hidden_layers layers. Each layer is a [LlamaDecoderLayer] :param config: the config of network :type config: LlamaConfig

Inputs:

input_ids: the tokenized inputs with datatype int32

返回

Tensor, the output of llama decoderlayer

返回类型

output