mindformers.models.glm.GLMForPreTrainingWithLora

class mindformers.models.glm.GLMForPreTrainingWithLora(config: Optional[GLMConfig] = None, **kwargs)

GLM Model for pretraining with LoRA

Args:

config (GLMConfig): The config of network.