mindformers.core.ClipGradNorm

class mindformers.core.ClipGradNorm(max_norm=1.0, use_norm=None)

Clips tensor values by the ratio of the sum of their norms.

参数

• max_norm (Union(float, int)) – The clipping ratio. Default: 1.0

• use_norm (Union(float, None)) – The global norm. Default: None

Inputs:

• x (Union(tuple[Tensor], list[Tensor])) - Input data to clip.

Outputs:

Tensor, a clipped Tensor.