mindformers.modules.transformer.OpParallelConfig¶

class mindformers.modules.transformer.OpParallelConfig(data_parallel=1, model_parallel=1, use_seq_parallel=False, select_recompute=False)[源代码]¶

OpParallelConfig for the setting data parallel and model parallel.

Args:

data_parallel (int): The data parallel way. Default: 1 model_parallel (int): The model parallel way. Default: 1

Supported Platforms:

Ascend GPU

Examples:

>>> from mindformers.modules import OpParallelConfig
>>> config=OpParallelConfig(data_parallel=1, model_parallel=1)