mindformers.models.gpt2.GPT2Processor¶

class mindformers.models.gpt2.GPT2Processor(tokenizer=None, max_length=128, padding='max_length', return_tensors='ms')[源代码]¶: GPT2 processor, consists of a tokenizer (BaseTokenizer) for text input.