mindformers.models.glm.GLMProcessor

class mindformers.models.glm.GLMProcessor(tokenizer=None, max_length=128, padding='max_length', return_tensors='ms')[源代码]

GLM processor, consists of a tokenizer (BaseTokenizer) for text input.