mindformers.models.llama.LlamaProcessor¶

class mindformers.models.llama.LlamaProcessor(tokenizer=None, max_length=128, padding='max_length', return_tensors='ms')[源代码]¶: Llama processor, consists of a tokenizer (BaseTokenizer) for text input.