mindformers.modules.transformer.OpParallelConfig

class mindformers.modules.transformer.OpParallelConfig(data_parallel=1, model_parallel=1)[源代码]

OpParallelConfig for the setting data parallel and model parallel.

参数

  • data_parallel (int) – The data parallel way. Default: 1

  • model_parallel (int) – The model parallel way. Default: 1

Supported Platforms:

Ascend GPU

实际案例

>>> from mindformers.modules import OpParallelConfig
>>> config=OpParallelConfig(data_parallel=1, model_parallel=1)