mindformers
stable
欢迎使用MindFormers
欢迎来到MindSpore Transformers(MindFormers)
特性
Trainer 组件
Pipeline 组件
AutoClass 组件
开发实践
Bert 下游任务微调
GPT2-13B 分布式训练
MindSpore 学习
模型
BERT
CLIP
GPT2
MAE
PanguAlpha
SWIN
T5
ViT
任务
Contrastive Language Image Pretrain
Image Classification
Question Answering
Text Classification
Token Classification
Zero Shot Image Classification
API
mindformers.core
mindformers.dataset
mindformers.models
mindformers.modules
mindformers.pipeline
mindformers
mindformers.trainer
mindformers.wrapper
FAQ
如何提交PR
mindformers
»
索引
索引
A
|
B
|
C
|
D
|
E
|
F
|
G
|
I
|
K
|
L
|
M
|
N
|
O
|
P
|
Q
|
R
|
S
|
T
|
U
|
V
|
Z
A
ADGENMetric (mindformers.core.metric 中的类)
AttentionMask (mindformers.modules.transformer 中的类)
AutoConfig (mindformers 中的类)
AutoModel (mindformers 中的类)
AutoProcessor (mindformers 中的类)
AutoTokenizer (mindformers 中的类)
B
BaseConfig (mindformers.models 中的类)
BaseDataset (mindformers.dataset 中的类)
BaseImageProcessor (mindformers.models 中的类)
BaseModel (mindformers.models 中的类)
BasePipeline (mindformers.pipeline 中的类)
BaseProcessor (mindformers.models 中的类)
bert_forward() (mindformers.models.bert.BertForPreTraining 方法)
BertConfig (mindformers.models.bert 中的类)
BertForMultipleChoice (mindformers.models.bert 中的类)
BertForPreTraining (mindformers.models.bert 中的类)
BertForQuestionAnswering (mindformers.models.bert 中的类)
BertModel (mindformers.models.bert 中的类)
BertProcessor (mindformers.models.bert 中的类)
BertTokenizer (mindformers.models.bert 中的类)
BloomConfig (mindformers.models.bloom 中的类)
BloomLMHeadModel (mindformers.models.bloom 中的类)
BloomModel (mindformers.models.bloom 中的类)
BloomProcessor (mindformers.models.bloom 中的类)
BloomTokenizer (mindformers.models.bloom 中的类)
bpe() (mindformers.models.bloom.BloomTokenizer 方法)
(mindformers.models.gpt2.GPT2Tokenizer 方法)
build_attention_mask() (mindformers.models.clip.CLIPModel 方法)
build_context() (在 mindformers.core 模块中)
build_inputs_with_special_tokens() (mindformers.models.clip.CLIPTokenizer 方法)
(mindformers.models.glm.ChatGLMTokenizer 方法)
(mindformers.models.gpt2.GPT2Tokenizer 方法)
(mindformers.models.llama.LlamaTokenizer 方法)
(mindformers.models.t5.T5Tokenizer 方法)
build_network() (mindformers.trainer.Trainer 方法)
C
CausalLanguageModelDataset (mindformers.dataset 中的类)
CausalLanguageModelingTrainer (mindformers.trainer 中的类)
ChatGLMTokenizer (mindformers.models.glm 中的类)
CheckpointMointor (mindformers.core.callback 中的类)
clear() (mindformers.core.metric.EntityScore 方法)
(mindformers.core.metric.PerplexityMetric 方法)
(mindformers.core.metric.SQuADMetric 方法)
CLIPConfig (mindformers.models.clip 中的类)
ClipGradNorm (mindformers.core 中的类)
CLIPImageProcessor (mindformers.models.clip 中的类)
CLIPModel (mindformers.models.clip 中的类)
CLIPProcessor (mindformers.models.clip 中的类)
CLIPTextConfig (mindformers.models.clip 中的类)
CLIPTokenizer (mindformers.models.clip 中的类)
CLIPVisionConfig (mindformers.models.clip 中的类)
clone_state() (mindformers.core.optim.FP32StateAdamWeightDecay 方法)
(mindformers.core.optim.FusedAdamWeightDecay 方法)
compute() (mindformers.core.metric.EntityScore 方法)
ConstantWarmUpLR (mindformers.core.lr 中的类)
construct_without_pool() (mindformers.models.vit.ViTModel 方法)
ContextConfig (mindformers.trainer 中的类)
ContrastiveLanguageImagePretrainDataset (mindformers.dataset 中的类)
ContrastiveLanguageImagePretrainTrainer (mindformers.trainer 中的类)
convert_args_to_mindformers_config() (mindformers.trainer.TrainingArguments 方法)
convert_ids_to_tokens() (mindformers.models.glm.ChatGLMTokenizer 方法)
(mindformers.models.Tokenizer 方法)
convert_tokens_to_ids() (mindformers.models.glm.ChatGLMTokenizer 方法)
(mindformers.models.Tokenizer 方法)
convert_tokens_to_string() (mindformers.models.bloom.BloomTokenizer 方法)
(mindformers.models.gpt2.GPT2Tokenizer 方法)
(mindformers.models.Tokenizer 方法)
CosineWithRestartsAndWarmUpLR (mindformers.core.lr 中的类)
CosineWithWarmUpLR (mindformers.core.lr 中的类)
create_position_ids() (mindformers.dataset.KeyWordGenDataset 类方法)
create_position_ids_np() (mindformers.models.glm.GLMForPreTraining 方法)
CrossEntropyLoss (mindformers.core.loss 中的类)
D
Dropout (mindformers.modules.layers 中的类)
E
EmbeddingOpParallelConfig (mindformers.modules.transformer 中的类)
encoder_forward() (mindformers.models.t5.T5ForConditionalGeneration 方法)
end_token_id() (mindformers.models.glm.ChatGLMTokenizer property)
EntityScore (mindformers.core.metric 中的类)
epoch_begin() (mindformers.core.callback.MFLossMonitor 方法)
epoch_end() (mindformers.core.callback.MFLossMonitor 方法)
eval() (mindformers.core.metric.ADGENMetric 方法)
(mindformers.core.metric.EntityScore 方法)
(mindformers.core.metric.PerplexityMetric 方法)
(mindformers.core.metric.SQuADMetric 方法)
eval_dataset_function() (mindformers.dataset.KeyWordGenDataset 类方法)
EvalCallBack (mindformers.core.callback 中的类)
evaluate() (mindformers.trainer.CausalLanguageModelingTrainer 方法)
(mindformers.trainer.ImageClassificationTrainer 方法)
(mindformers.trainer.QuestionAnsweringTrainer 方法)
(mindformers.trainer.TextClassificationTrainer 方法)
(mindformers.trainer.TokenClassificationTrainer 方法)
(mindformers.trainer.Trainer 方法)
(mindformers.trainer.ZeroShotImageClassificationTrainer 方法)
F
FeedForward (mindformers.modules.transformer 中的类)
FILE_LIST (mindformers.models.clip.CLIPTokenizer 属性)
FillMaskPipeline (mindformers.pipeline 中的类)
finetune() (mindformers.trainer.Trainer 方法)
fix_init_weight() (mindformers.models.vit.ViTModel 方法)
FixedSparseAttention (mindformers.modules.layers 中的类)
forward() (mindformers.pipeline.BasePipeline 方法)
(mindformers.pipeline.FillMaskPipeline 方法)
(mindformers.pipeline.ImageClassificationPipeline 方法)
(mindformers.pipeline.TextClassificationPipeline 方法)
(mindformers.pipeline.TokenClassificationPipeline 方法)
(mindformers.pipeline.TranslationPipeline 方法)
(mindformers.pipeline.ZeroShotImageClassificationPipeline 方法)
FP32StateAdamWeightDecay (mindformers.core.optim 中的类)
from_config() (mindformers.AutoModel 类方法)
from_pretrained() (mindformers.AutoConfig 类方法)
(mindformers.AutoModel 类方法)
(mindformers.AutoProcessor 类方法)
(mindformers.AutoTokenizer 类方法)
(mindformers.models.BaseConfig 类方法)
(mindformers.models.BaseModel 类方法)
(mindformers.models.BaseProcessor 类方法)
FusedAdamWeightDecay (mindformers.core.optim 中的类)
G
generate_evaluate() (mindformers.trainer.CausalLanguageModelingTrainer 方法)
get_device_id() (mindformers.trainer.TrainingArguments property)
get_device_num() (mindformers.trainer.TrainingArguments property)
get_dtype() (mindformers.models.clip.CLIPModel 方法)
get_entities_bios() (mindformers.core.metric.EntityScore 方法)
(mindformers.pipeline.TokenClassificationPipeline 方法)
get_eval_dataloader() (mindformers.trainer.Trainer 方法)
get_image_features() (mindformers.models.clip.CLIPModel 方法)
get_last_checkpoint() (mindformers.trainer.Trainer 方法)
get_loss() (mindformers.core.loss.L1Loss 方法)
get_masks() (mindformers.dataset.KeyWordGenDataset 类方法)
get_position_ids() (mindformers.dataset.KeyWordGenDataset 类方法)
get_position_ids_np() (mindformers.models.glm.GLMForPreTraining 方法)
get_rank_id() (mindformers.trainer.TrainingArguments property)
get_support_list() (mindformers.AutoConfig 类方法)
(mindformers.AutoModel 类方法)
(mindformers.AutoProcessor 类方法)
(mindformers.AutoTokenizer 类方法)
(mindformers.models.BaseConfig 类方法)
(mindformers.models.BaseModel 类方法)
(mindformers.models.BaseProcessor 类方法)
(mindformers.models.Tokenizer 类方法)
get_text_features() (mindformers.models.clip.CLIPModel 方法)
get_top_token_id() (mindformers.models.bloom.BloomLMHeadModel 方法)
get_train_dataloader() (mindformers.trainer.Trainer 方法)
get_vocab() (mindformers.models.glm.ChatGLMTokenizer 方法)
GLMChatModel (mindformers.models.glm 中的类)
GLMChatModelWithLora (mindformers.models.glm 中的类)
GLMConfig (mindformers.models.glm 中的类)
GLMForPreTraining (mindformers.models.glm 中的类)
GLMForPreTrainingWithLora (mindformers.models.glm 中的类)
GLMProcessor (mindformers.models.glm 中的类)
GPT2Config (mindformers.models.gpt2 中的类)
GPT2LMHeadModel (mindformers.models.gpt2 中的类)
GPT2Model (mindformers.models.gpt2 中的类)
GPT2Processor (mindformers.models.gpt2 中的类)
GPT2Tokenizer (mindformers.models.gpt2 中的类)
I
ImageClassificationPipeline (mindformers.pipeline 中的类)
ImageClassificationTrainer (mindformers.trainer 中的类)
ImageCLSDataset (mindformers.dataset 中的类)
ImageToTextRetrievalDataset (mindformers.dataset 中的类)
init_context() (在 mindformers.core 模块中)
init_dataset_config() (mindformers.dataset.BaseDataset 类方法)
init_pos_emd() (mindformers.models.mae.ViTMAEForPreTraining 方法)
init_weights() (mindformers.models.mae.ViTMAEForPreTraining 方法)
init_weights_vit() (mindformers.models.vit.ViTModel 方法)
inputs_process() (mindformers.pipeline.TextClassificationPipeline 方法)
invalid_model_name() (mindformers.AutoModel 类方法)
invalid_yaml_name() (mindformers.AutoConfig 类方法)
(mindformers.AutoProcessor 类方法)
(mindformers.AutoTokenizer 类方法)
inverse_parse_config() (mindformers.models.BaseConfig 方法)
K
KeyWordGenDataset (mindformers.dataset 中的类)
L
L1Loss (mindformers.core.loss 中的类)
LayerNorm (mindformers.modules.layers 中的类)
Linear (mindformers.modules.layers 中的类)
LinearWithWarmUpLR (mindformers.core.lr 中的类)
LlamaConfig (mindformers.models.llama 中的类)
LlamaForCausalLM (mindformers.models.llama 中的类)
LlamaForCausalLMWithLora (mindformers.models.llama 中的类)
LlamaModel (mindformers.models.llama 中的类)
LlamaProcessor (mindformers.models.llama 中的类)
LlamaTokenizer (mindformers.models.llama 中的类)
load_checkpoint() (mindformers.models.BaseModel 方法)
(mindformers.models.swin.SwinForImageClassification 方法)
M
MaskedImageModelingTrainer (mindformers.trainer 中的类)
MaskedLanguageModelingTrainer (mindformers.trainer 中的类)
MaskLanguageModelDataset (mindformers.dataset 中的类)
MFLossMonitor (mindformers.core.callback 中的类)
MFPipelineWithLossScaleCell (mindformers.wrapper 中的类)
MFTrainOneStepCell (mindformers.wrapper 中的类)
MIMDataset (mindformers.dataset 中的类)
mindformers (模块)
mindformers.core (模块)
mindformers.dataset (模块)
mindformers.models (模块)
mindformers.modules (模块)
mindformers.pipeline (模块)
mindformers.trainer (模块)
mindformers.wrapper (模块)
MoEConfig (mindformers.modules.transformer 中的类)
MSELoss (mindformers.core.loss 中的类)
MultiHeadAttention (mindformers.modules.transformer 中的类)
N
num_special_tokens_to_add() (mindformers.models.Tokenizer 方法)
O
ObsMonitor (mindformers.core.callback 中的类)
OpParallelConfig (mindformers.modules.transformer 中的类)
P
ParallelContextConfig (mindformers.trainer 中的类)
PerplexityMetric (mindformers.core.metric 中的类)
pipeline() (在 mindformers.pipeline 模块中)
PolynomialWithWarmUpLR (mindformers.core.lr 中的类)
postprocess() (mindformers.pipeline.BasePipeline 方法)
(mindformers.pipeline.FillMaskPipeline 方法)
(mindformers.pipeline.ImageClassificationPipeline 方法)
(mindformers.pipeline.TextClassificationPipeline 方法)
(mindformers.pipeline.TokenClassificationPipeline 方法)
(mindformers.pipeline.TranslationPipeline 方法)
(mindformers.pipeline.ZeroShotImageClassificationPipeline 方法)
predict() (mindformers.trainer.CausalLanguageModelingTrainer 方法)
(mindformers.trainer.ImageClassificationTrainer 方法)
(mindformers.trainer.MaskedImageModelingTrainer 方法)
(mindformers.trainer.MaskedLanguageModelingTrainer 方法)
(mindformers.trainer.QuestionAnsweringTrainer 方法)
(mindformers.trainer.TextClassificationTrainer 方法)
(mindformers.trainer.TokenClassificationTrainer 方法)
(mindformers.trainer.Trainer 方法)
(mindformers.trainer.TranslationTrainer 方法)
(mindformers.trainer.ZeroShotImageClassificationTrainer 方法)
prepare_for_tokenization() (mindformers.models.bloom.BloomTokenizer 方法)
(mindformers.models.gpt2.GPT2Tokenizer 方法)
preprocess() (mindformers.models.BaseImageProcessor 方法)
(mindformers.models.clip.CLIPImageProcessor 方法)
(mindformers.models.mae.ViTMAEImageProcessor 方法)
(mindformers.models.swin.SwinImageProcessor 方法)
(mindformers.models.vit.ViTImageProcessor 方法)
(mindformers.pipeline.BasePipeline 方法)
(mindformers.pipeline.FillMaskPipeline 方法)
(mindformers.pipeline.ImageClassificationPipeline 方法)
(mindformers.pipeline.TextClassificationPipeline 方法)
(mindformers.pipeline.TokenClassificationPipeline 方法)
(mindformers.pipeline.TranslationPipeline 方法)
(mindformers.pipeline.ZeroShotImageClassificationPipeline 方法)
preprocess_text() (mindformers.models.glm.ChatGLMTokenizer 方法)
print_output_info() (mindformers.core.callback.MFLossMonitor 方法)
ProfileMonitor (mindformers.core.callback 中的类)
Q
QuestionAnsweringTrainer (mindformers.trainer 中的类)
R
remap_pretrained_keys_swin() (mindformers.models.swin.SwinForImageClassification 方法)
remove_type() (mindformers.models.BaseConfig 方法)
(mindformers.models.BaseModel 方法)
reset_model_instance() (mindformers.trainer.Trainer 方法)
run_multi() (mindformers.pipeline.BasePipeline 方法)
run_single() (mindformers.pipeline.BasePipeline 方法)
S
sample() (mindformers.models.glm.GLMChatModel 方法)
save_config_to_yaml() (mindformers.trainer.Trainer 方法)
save_pretrained() (mindformers.models.BaseConfig 方法)
(mindformers.models.BaseModel 方法)
(mindformers.models.BaseProcessor 方法)
save_vocabulary() (mindformers.models.bert.BertTokenizer 方法)
(mindformers.models.bloom.BloomTokenizer 方法)
(mindformers.models.clip.CLIPTokenizer 方法)
(mindformers.models.glm.ChatGLMTokenizer 方法)
(mindformers.models.gpt2.GPT2Tokenizer 方法)
(mindformers.models.llama.LlamaTokenizer 方法)
(mindformers.models.t5.T5Tokenizer 方法)
set_moe_config() (mindformers.trainer.Trainer 方法)
set_parallel_config() (mindformers.trainer.Trainer 方法)
set_recompute_config() (mindformers.trainer.Trainer 方法)
shard() (mindformers.modules.layers.LayerNorm 方法)
(mindformers.modules.layers.Linear 方法)
show_support_list() (mindformers.AutoConfig 类方法)
(mindformers.AutoModel 类方法)
(mindformers.AutoProcessor 类方法)
(mindformers.AutoTokenizer 类方法)
(mindformers.models.BaseConfig 类方法)
(mindformers.models.BaseModel 类方法)
(mindformers.models.BaseProcessor 类方法)
(mindformers.models.Tokenizer 类方法)
(mindformers.pipeline.BasePipeline 类方法)
SoftTargetCrossEntropy (mindformers.core.loss 中的类)
SQuADMetric (mindformers.core.metric 中的类)
step_begin() (mindformers.core.callback.MFLossMonitor 方法)
(mindformers.core.callback.ProfileMonitor 方法)
step_end() (mindformers.core.callback.MFLossMonitor 方法)
(mindformers.core.callback.ProfileMonitor 方法)
SummaryMonitor (mindformers.core.callback 中的类)
SwinConfig (mindformers.models.swin 中的类)
SwinForImageClassification (mindformers.models.swin 中的类)
SwinImageProcessor (mindformers.models.swin 中的类)
SwinModel (mindformers.models.swin 中的类)
SwinProcessor (mindformers.models.swin 中的类)
T
T5Config (mindformers.models.t5 中的类)
T5ForConditionalGeneration (mindformers.models.t5 中的类)
T5Processor (mindformers.models.t5 中的类)
T5Tokenizer (mindformers.models.t5 中的类)
TextClassificationDataset (mindformers.dataset 中的类)
TextClassificationPipeline (mindformers.pipeline 中的类)
TextClassificationTrainer (mindformers.trainer 中的类)
to_dict() (mindformers.models.BaseConfig 方法)
TokenClassificationDataset (mindformers.dataset 中的类)
TokenClassificationPipeline (mindformers.pipeline 中的类)
TokenClassificationTrainer (mindformers.trainer 中的类)
tokenize() (mindformers.models.clip.CLIPTokenizer 方法)
(mindformers.models.glm.ChatGLMTokenizer 方法)
(mindformers.models.llama.LlamaTokenizer 方法)
(mindformers.models.t5.T5Tokenizer 方法)
Tokenizer (mindformers.models 中的类)
train() (mindformers.trainer.CausalLanguageModelingTrainer 方法)
(mindformers.trainer.ContrastiveLanguageImagePretrainTrainer 方法)
(mindformers.trainer.ImageClassificationTrainer 方法)
(mindformers.trainer.MaskedImageModelingTrainer 方法)
(mindformers.trainer.MaskedLanguageModelingTrainer 方法)
(mindformers.trainer.QuestionAnsweringTrainer 方法)
(mindformers.trainer.TextClassificationTrainer 方法)
(mindformers.trainer.TokenClassificationTrainer 方法)
(mindformers.trainer.Trainer 方法)
(mindformers.trainer.TranslationTrainer 方法)
train_dataset_function() (mindformers.dataset.KeyWordGenDataset 类方法)
Trainer (mindformers.trainer 中的类)
TrainingArguments (mindformers.trainer 中的类)
Transformer (mindformers.modules.transformer 中的类)
TransformerDecoder (mindformers.modules.transformer 中的类)
TransformerDecoderLayer (mindformers.modules.transformer 中的类)
TransformerEncoder (mindformers.modules.transformer 中的类)
TransformerEncoderLayer (mindformers.modules.transformer 中的类)
TransformerOpParallelConfig (mindformers.modules.transformer 中的类)
TransformerRecomputeConfig (mindformers.modules.transformer 中的类)
TranslationPipeline (mindformers.pipeline 中的类)
TranslationTrainer (mindformers.trainer 中的类)
U
update() (mindformers.core.metric.ADGENMetric 方法)
(mindformers.core.metric.EntityScore 方法)
(mindformers.core.metric.PerplexityMetric 方法)
(mindformers.core.metric.SQuADMetric 方法)
V
variance() (mindformers.core.loss.MSELoss 方法)
ViTConfig (mindformers.models.vit 中的类)
ViTForImageClassification (mindformers.models.vit 中的类)
ViTImageProcessor (mindformers.models.vit 中的类)
ViTMAEConfig (mindformers.models.mae 中的类)
ViTMAEForPreTraining (mindformers.models.mae 中的类)
ViTMAEImageProcessor (mindformers.models.mae 中的类)
ViTMAEProcessor (mindformers.models.mae 中的类)
ViTModel (mindformers.models.vit 中的类)
ViTProcessor (mindformers.models.vit 中的类)
vocab_size() (mindformers.models.bert.BertTokenizer property)
(mindformers.models.bloom.BloomTokenizer property)
(mindformers.models.clip.CLIPTokenizer property)
(mindformers.models.glm.ChatGLMTokenizer property)
(mindformers.models.gpt2.GPT2Tokenizer property)
(mindformers.models.llama.LlamaTokenizer property)
(mindformers.models.t5.T5Tokenizer property)
(mindformers.models.Tokenizer property)
VocabEmbedding (mindformers.modules.transformer 中的类)
Z
ZeroShotImageClassificationDataset (mindformers.dataset 中的类)
ZeroShotImageClassificationPipeline (mindformers.pipeline 中的类)
ZeroShotImageClassificationTrainer (mindformers.trainer 中的类)